-- Logs begin at Mon 2022-07-18 15:47:22 UTC, end at Mon 2022-07-18 17:37:05 UTC. -- Jul 18 16:36:22.241809 dv-cinder-846172-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 16:36:22.250095 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:36:22 2022] *** Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: nodename: dv-cinder-846172-3-iscsi Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: machine: x86_64 Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: clock source: unix Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: pcre jit disabled Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: detected number of CPU cores: 4 Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: current working directory: / Jul 18 16:36:22.252832 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:36:22.253456 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: your processes number limit is 47680 Jul 18 16:36:22.253456 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: your memory page size is 4096 bytes Jul 18 16:36:22.253456 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: detected max file descriptor number: 2048 Jul 18 16:36:22.253456 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: lock engine: pthread robust mutexes Jul 18 16:36:22.253456 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: thunder lock: enabled Jul 18 16:36:22.253456 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 16:36:22.253456 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:36:22.293274 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: Python main interpreter initialized at 0x564d3289f9c0 Jul 18 16:36:22.293274 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: python threads support enabled Jul 18 16:36:22.293274 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: your server socket listen backlog is limited to 100 connections Jul 18 16:36:22.293274 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:36:22.293673 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:36:22.293673 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: *** Operational MODE: preforking *** Jul 18 16:36:22.293959 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:36:22.293959 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: spawned uWSGI master process (pid: 110371) Jul 18 16:36:22.294171 dv-cinder-846172-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 16:36:22.296887 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: spawned uWSGI worker 1 (pid: 110372, cores: 1) Jul 18 16:36:22.296887 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: spawned uWSGI worker 2 (pid: 110373, cores: 1) Jul 18 16:36:22.296887 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:36:22.966604 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:36:22.980088 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:36:24.078545 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:36:24.078545 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: from cryptography.utils import int_from_bytes Jul 18 16:36:24.079241 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:36:24.079241 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: from cryptography.utils import int_from_bytes Jul 18 16:36:24.079656 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:36:24.079656 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: from cryptography.utils import int_from_bytes Jul 18 16:36:24.079771 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:36:24.079771 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: from cryptography.utils import int_from_bytes Jul 18 16:36:26.609715 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:36:26.610468 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:36:26.610468 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:36:26.610841 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:36:26.611096 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:36:26.611190 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:36:26.611591 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:36:26.611684 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.611821 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.611922 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:36:26.612143 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.612246 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:36:26.612461 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.612554 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:36:26.612792 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.612963 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.613101 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.613198 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.613428 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.613530 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.613745 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.613843 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.614074 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.614165 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.614335 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.614427 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.614652 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.614747 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.614978 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.615072 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-3-iscsi {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.615301 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.615392 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.615611 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.615759 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.615918 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.616011 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.616242 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-3-iscsi {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.616347 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.616562 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.616665 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.616862 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.616961 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.617165 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.617266 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.617478 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.617699 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.617809 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.618084 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.618190 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.618384 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.618471 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.618745 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.618875 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.619087 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.619188 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.619406 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.620028 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.620308 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.620405 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.620635 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.620735 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.620951 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.621073 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.621349 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.621442 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.621665 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.621753 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.621973 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.622081 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-3-iscsi {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.622293 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.622399 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.622596 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.622683 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.622974 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.623070 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-3-iscsi {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.623283 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.623379 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.623611 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.623758 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.623921 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.624015 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.624333 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.624437 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.624636 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.624730 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.624944 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.625040 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.625264 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.625374 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.625584 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.625669 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.625884 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.625976 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.626220 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.626322 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.626526 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.626623 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.626838 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.626952 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.627173 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.627267 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.627473 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.627582 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.627800 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.627894 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.628105 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.628192 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.628374 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.628466 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.628686 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.628772 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.628998 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.629084 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.629245 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.629390 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.629548 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.629645 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.629866 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.629953 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.630115 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.630210 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.630439 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.630539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.630723 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.630809 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.630968 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.631054 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.631285 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.631379 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.631621 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.631722 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.631928 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.632014 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.632254 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.632408 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.632579 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.632673 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.632884 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.632991 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.633190 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.633296 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.633494 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.633581 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.633795 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.633888 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.634098 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.634185 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.634424 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.634528 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.634730 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.634829 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.635049 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.635832 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.636059 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.636181 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.636374 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.636647 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.636742 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.637025 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.637121 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.637287 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.637373 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.637594 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.637680 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.637953 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.638039 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.638275 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.638360 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.638579 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.638667 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.638896 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.638990 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.639213 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.639306 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.639534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.639635 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.639839 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.639933 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.640117 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.640284 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.640421 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.640523 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.640730 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.640825 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.641049 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.641147 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.641297 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.641383 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.641594 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.641690 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.641894 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.641988 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.642210 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.642295 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.642511 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.642597 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.642814 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.642908 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.643114 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.643215 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.643412 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.643536 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.643743 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.643837 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.644043 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.644135 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.644348 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.644458 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.644653 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.644760 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.644953 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.645041 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.645254 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.645348 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.645556 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.645643 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.645855 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.645946 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.646155 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.646241 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.646463 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.646555 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.646771 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.646914 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.647075 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.647168 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.647377 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.647464 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.647704 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.647802 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.648007 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.648093 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.648323 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.648417 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.648625 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.648719 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.648929 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.649015 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.649237 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.649327 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.649536 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.649703 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.649976 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.650067 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.650285 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.650381 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.650588 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.650751 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.650977 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.651117 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.651293 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.651380 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.651611 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.651702 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.651917 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.652018 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.652223 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.652308 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.652525 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.652663 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.652828 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.652931 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.653132 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.653268 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.653433 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.653546 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.653736 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.653842 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.654034 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.654130 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.654332 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.654422 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.654631 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.654733 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.654925 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.655021 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.655449 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.655577 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.655793 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.655885 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.656105 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.656205 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.656414 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.656511 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.656719 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.656863 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.657036 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:36:26.657182 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.657370 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.657518 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.657703 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.657852 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.658046 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.658180 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.658361 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.658495 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.658693 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.658793 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.659025 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.659129 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.659342 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.659438 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.659687 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.659778 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.660002 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.660097 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.660339 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.660435 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.660663 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.660749 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.660975 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.661067 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.661301 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.661415 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.661617 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.661705 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.661936 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.662023 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.662250 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.662345 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.662570 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.662657 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.662942 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.663041 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.663280 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.663384 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.663638 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.663748 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.663956 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.664043 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.664287 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.664391 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.664607 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.664693 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.664919 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.665019 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.665259 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.665347 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.665611 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.665739 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.665927 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.666042 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.666241 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.666346 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.666595 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.666740 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.666989 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.667157 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.667289 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.667398 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.667679 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.667820 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.667976 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.668142 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.668294 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.668472 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.668611 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.668791 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.668926 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.669107 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.669241 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.669418 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.669581 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.669728 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.669900 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.670058 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.670219 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.670331 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.670534 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.670640 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.670853 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.670971 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.671169 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.671282 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.671483 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.671615 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.671817 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.671926 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.672125 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.672236 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.672433 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.672528 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.672741 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.672881 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.673052 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.673140 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.673358 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.673450 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.673685 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.673800 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.674014 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.674110 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.674324 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.674417 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.674621 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.674720 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.674939 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.675038 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.675254 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.675360 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.675845 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.675948 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.676197 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.676289 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.676520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.676623 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.676827 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.676927 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.677132 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.677223 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.677437 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.677538 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.677739 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.677831 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.678046 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.678145 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.678352 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.678457 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.678653 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.678752 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.679026 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.679120 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.679297 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.679407 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.679601 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.679691 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.679923 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.680021 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.680225 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.680313 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.680524 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.680618 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.680833 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.680934 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.681162 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.681272 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.681467 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.681592 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.681775 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.681911 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.682712 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.682839 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.683125 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.683273 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.683404 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.683770 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.683919 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.684093 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.684406 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.684501 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.684716 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.685030 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.685166 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.685326 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.685614 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.685701 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.685928 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.686152 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.686239 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.686534 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.686742 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.686971 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.687283 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.687382 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.687617 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.687927 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.688020 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.688262 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.688364 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.688578 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.688664 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.689863 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.689983 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690061 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690137 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690204 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690281 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690367 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690446 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690446 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690604 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690698 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.690779 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.691284 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.691388 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.691479 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.691653 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.691748 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.691827 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.691827 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.691969 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.692119 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.692434 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.692520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.692879 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.693074 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.693198 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.693514 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.693657 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.693837 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.695301 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.695397 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.695479 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.695605 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.695688 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.695755 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.695755 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.695872 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.695937 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696011 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696077 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696142 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696214 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696280 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696345 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696417 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696687 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696764 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.696998 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.697073 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.697315 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.699860 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.699860 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700014 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700093 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700170 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700257 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700331 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700404 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700482 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700563 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700641 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700727 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700806 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700883 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.700969 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701049 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701127 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701212 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701291 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701368 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701445 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701521 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701610 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701728 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.701824 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.702043 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.702195 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.702366 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.702518 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.702676 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.702843 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.702995 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.703154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.703326 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.703467 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.703691 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.703788 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.704006 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.704153 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.704322 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.704418 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.704646 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.704734 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.704960 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.705057 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.705311 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.705397 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.705629 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.705716 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.705939 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.706032 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.706263 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.706362 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.706572 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.706659 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.706897 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.706982 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.707207 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.707302 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.707536 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.707626 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.707847 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.707935 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.708163 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.708258 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.708478 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.708564 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.708784 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.708877 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.709090 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.709184 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.709396 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.709481 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.709717 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.709809 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.710025 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.710111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.710331 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.710417 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.710634 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.710729 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.710941 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.711034 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.711276 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.711364 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.711611 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.711714 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.711919 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.712006 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.712223 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.712310 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.712574 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.712674 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.712866 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.712952 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.713167 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.713364 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.713633 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.713723 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.713962 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.714344 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.714445 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.714534 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.714612 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.714789 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.714888 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.715108 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.715212 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.715463 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.715642 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.715773 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.715861 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.716091 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.716178 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.716419 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.716517 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.716744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.716868 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.717076 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.717233 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.717380 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.717556 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.717723 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.717875 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.718053 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.718248 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.718344 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.718571 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.718659 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.718908 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.718994 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.719224 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.719319 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.719566 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.719664 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.719885 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.719972 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.720190 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.720289 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.720504 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.720589 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.720813 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.720897 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.721120 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.721398 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.721486 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.721721 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.721807 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.722030 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.722125 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.722337 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.722424 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.722657 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.722743 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.722963 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.723059 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.723270 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.723358 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.723600 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.723696 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.723995 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.724186 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.724285 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.724520 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.724611 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.724843 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.725112 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.725207 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.725456 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.725565 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.725771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.725877 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.726076 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.726161 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.726386 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.726482 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.726693 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.726781 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.727007 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.727106 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.727316 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.727403 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.727652 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.727748 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.727961 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.728059 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.728270 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.728366 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.728578 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.728663 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.729481 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.729598 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.729737 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.729892 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.730040 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.730206 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.730344 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.730536 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.730682 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.730852 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.730948 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.731163 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.731261 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.731472 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.731638 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.731804 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.731898 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.732150 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.732237 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.732462 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.732548 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.732767 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.732854 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.733076 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.733164 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.733381 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.733476 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.733707 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.733797 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.734012 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.734101 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.734317 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.734405 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.734617 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.734703 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.734920 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.735019 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.735237 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.735331 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.735573 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.735665 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.735890 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.736002 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.736194 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.736282 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.736506 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.736592 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.736817 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.736913 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.737132 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.737226 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.737444 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.737531 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.737807 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.737901 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.738109 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.738195 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.738410 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.738498 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.738717 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.738812 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.739021 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.739108 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.739320 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.739406 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.739650 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.739740 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.739959 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.740046 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.740265 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.740353 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.740571 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.740664 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.740892 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.741003 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.741202 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.741362 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.741491 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.741577 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.741793 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.741881 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.742096 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.742192 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.742395 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.742484 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.742693 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.742781 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.743023 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.743118 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.743349 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.743437 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.743678 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.743792 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.743983 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.744089 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.744281 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.744368 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.745192 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.745300 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.745500 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.745681 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.745805 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.745913 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.746108 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.746218 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.746413 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.746528 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.746716 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.746804 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.747059 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.747190 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.747379 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.747476 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.747712 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.747856 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.748015 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.748109 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.748315 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.748404 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.748641 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.748733 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.748942 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.749030 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.749242 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.749339 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.749554 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.749647 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.749862 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.749949 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.750172 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.750260 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.750479 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.750566 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.750783 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.750882 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.751085 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.751172 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.751385 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.751472 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.751709 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.751807 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.752013 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.752106 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.752333 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.752426 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.752652 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.752747 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.752953 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.753046 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.753272 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.753359 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.753580 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.753675 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.753900 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.753998 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.754225 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.754313 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.754551 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.754647 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.754852 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.754949 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.755152 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.755241 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.755471 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.755628 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.755806 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.755892 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.756168 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.756285 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.756474 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.756574 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.756778 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.756871 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.757092 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.757177 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.757401 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.757490 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.757709 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.757796 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.758017 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.758117 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.758339 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.758426 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.758673 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.758760 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.758980 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.759079 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.759289 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.759375 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.759614 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.759717 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.759917 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.760012 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.760369 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.760462 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.760555 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.760632 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.760863 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.761014 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.761177 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.761272 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.761492 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.761580 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.761810 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.761904 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.762109 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.762194 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.762412 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.762498 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.762720 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.762808 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.763025 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.763122 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.763332 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.763418 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.763676 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.763766 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.763990 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.764089 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.764298 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.764386 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.764605 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.764693 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.764913 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.765000 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.765221 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.765307 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.765524 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.765611 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.765867 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.765959 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.766172 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.766285 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.766477 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.766584 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.766798 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.766886 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.767101 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.767200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.767402 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.767515 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.767730 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.767817 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.768029 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.768133 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.768336 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.768423 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.768635 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.768773 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.769063 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.769158 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.769370 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.769457 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.769691 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.769777 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.769998 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.770087 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.770304 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.770389 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.770610 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.770697 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.770920 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.771050 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.771230 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.771316 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.771548 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.771640 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.771856 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.771985 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.772184 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.772294 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.772492 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.772600 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.772818 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.772905 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.773196 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.773281 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.773498 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.773594 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.773804 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.773891 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.774125 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.774229 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.774426 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.774522 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.774769 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.774870 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.775078 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.775168 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.775409 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.775520 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.775934 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.776028 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.776251 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.776378 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.776575 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.776799 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.776890 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.777119 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.777215 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.777495 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.777603 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.777817 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.777904 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.778136 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.778234 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.778442 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.778528 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.778762 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.778857 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.779082 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.779169 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.779398 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.779597 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.779721 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.779826 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.780032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.780158 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.780361 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.780486 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.780685 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.780802 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.781008 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.781126 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.781351 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.781510 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.781649 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.781821 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.781951 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.782127 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.782270 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.782440 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.782587 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.782747 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.782946 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.783054 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.783272 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.783380 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.783703 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.783796 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.784018 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.784152 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.784322 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.784408 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.784632 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.784719 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.784935 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.785022 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.785239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.785333 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.785538 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.785626 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.785842 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.785929 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.786141 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.786240 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.786441 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.786530 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.786783 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.786882 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.787102 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.787198 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.787411 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.787545 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.787743 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.787871 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.788047 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.788146 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.788349 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.788437 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.788659 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.788744 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.788965 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.789100 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.789281 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.789367 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.789601 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.789686 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.789911 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.789998 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.790232 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.790327 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.790549 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.790636 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.790852 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.790941 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.791172 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.791325 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.792066 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.792153 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.792423 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.792501 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.792753 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.792840 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.793066 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.793166 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.793409 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.793497 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.793713 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.793808 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.794028 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.794162 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.794340 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.794430 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.794649 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.794749 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.794990 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.795085 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.795305 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.795391 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.795637 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.795728 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.795945 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.796045 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.796252 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.796339 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.796577 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.796662 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.796886 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.797000 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.797193 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.797302 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.797497 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.797585 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.797799 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.797887 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.798125 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.798212 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.798428 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.798522 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.798734 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.798822 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.799034 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.799121 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.799334 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.799421 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.799657 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.799746 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.799998 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.800085 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.800303 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.800406 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.800890 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.800984 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.801197 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.801285 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.801499 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.801599 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.801800 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.801888 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.802101 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.802188 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.802439 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.802535 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.802739 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.802826 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.803073 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.803158 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.803385 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.803479 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.803721 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.803817 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.804063 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.804157 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.804374 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.804535 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.804695 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.804783 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.805009 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.805229 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.805364 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.805564 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.805652 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.805883 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.805970 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.806200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.806296 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.806518 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.806605 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.806827 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.806912 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.807934 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.808072 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.808192 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.808283 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.808363 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.808441 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.808655 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.808753 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.808985 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.809181 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.809318 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.809530 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.809629 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.809864 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.809959 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.810178 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.810365 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.810508 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.810689 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.810819 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.811010 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.811128 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.811331 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.811432 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.811687 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.811789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.812043 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.812129 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.812350 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.812451 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.812659 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.812751 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.812977 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.813064 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.813296 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.813388 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.813615 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.813702 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.813925 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.814012 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.814235 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.814332 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.814549 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.814635 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.814864 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.814951 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.815180 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.815269 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.815556 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.815667 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.815862 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.815973 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.816170 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.816265 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.816483 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.816578 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.816793 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.816889 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.817104 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.817192 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.817426 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.817512 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.817736 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.817832 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.818044 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.818133 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.818350 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.818569 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.818670 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.818886 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.819009 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.819223 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.819319 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.819572 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.819677 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.819903 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.819995 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.820216 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.820302 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.820526 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.820625 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.820849 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.820936 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.821156 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.821242 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.821539 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.821689 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.821863 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.821997 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.822179 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.822324 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.822489 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.822782 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.822866 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.823008 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.823189 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.823407 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.823535 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.823747 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.823849 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.824071 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.824159 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.824375 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.824651 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.824748 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.824969 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.825055 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.825273 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.825370 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.825574 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.825669 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.825890 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.825986 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.826197 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.826294 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.826497 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.826588 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.826815 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.826954 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.827225 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.827351 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.829981 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.830133 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.830249 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.830249 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.830448 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.830577 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.830687 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.830794 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.830901 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.831006 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.831120 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.831228 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.831333 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.831438 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.831567 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.831679 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.831804 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.831912 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.832017 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.832122 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.832235 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.832349 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.832465 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.832579 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.832685 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.832797 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.832911 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.833024 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.833138 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.833245 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.833363 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.833470 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.833582 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.833696 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.833813 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.833927 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.834033 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.834033 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.834229 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.834229 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.835011 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.835122 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.835248 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.835363 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.835617 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.835617 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.835849 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.835964 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836071 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836176 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836295 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836413 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836547 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836636 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836715 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836805 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836898 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.836979 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837057 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837142 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837221 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837311 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837397 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837477 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837554 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837632 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837717 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837804 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.837969 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.838058 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.838403 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.838547 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.838726 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.838827 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.839055 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.839285 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.839383 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.839648 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.839742 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.839972 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.840060 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.840313 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.840399 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.840622 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.840717 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.840931 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.841018 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.841247 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.841338 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.841561 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.841671 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.841888 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.842124 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.842212 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.842454 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.842543 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.842776 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.842865 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.843105 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.843191 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.843419 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.843529 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.843745 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.843831 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.844045 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.844132 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.844406 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.844523 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.844709 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.844802 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.845017 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.845105 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.845325 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.845421 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.845630 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.845725 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.845940 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.846033 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.846248 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.846383 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.846554 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.846650 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.846858 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.846946 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.847164 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.847260 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.847467 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.847627 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.847791 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.847879 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.848095 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.848184 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.848401 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.848488 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.848705 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.848835 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.849014 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.849103 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.849351 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.849438 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.849690 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.849796 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.850006 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.850120 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.850343 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.850444 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.850659 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.850850 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.850983 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.851171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.851257 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.851511 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.851613 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.851845 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.851934 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.852162 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.852249 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.852489 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.852585 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.852817 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.852913 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.853119 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.853204 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.853444 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.853539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.853760 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.854433 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.854646 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.854950 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.855038 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.855277 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.855564 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.855692 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.855898 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.856019 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.856242 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.856342 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.856552 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.856644 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.856861 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.856949 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.857176 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.857266 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.857501 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.857587 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.857822 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.857921 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.858132 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.858227 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.858440 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.858526 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.858755 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.858851 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.859065 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.859153 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.859373 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.859468 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.859705 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.859848 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.860014 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.860107 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.860319 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.860405 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.860624 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.860721 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.860929 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.861023 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.861235 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.861321 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.861557 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.861654 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.861859 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.861946 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.862221 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.862316 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.862524 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.862612 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.862837 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.862923 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.863138 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.863232 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.863547 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.863659 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.863839 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.863927 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.864144 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.864231 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.864449 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.864539 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.864750 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.864846 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.865057 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.865145 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.865360 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.865449 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.865662 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.865750 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.865962 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.866063 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.866263 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.866351 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.866563 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.866649 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.866892 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.867010 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.867328 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.867421 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.867693 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.867794 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.868022 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.868123 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.868367 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.868454 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.868687 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.868774 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.869005 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.869105 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.869323 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.869411 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.870316 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.870434 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.870634 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.870735 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.870944 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.871039 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.871273 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.871360 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.871611 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.871705 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.871921 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.872020 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.872229 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.872325 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.872537 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.872626 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.872850 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.872939 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.873158 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.873254 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.873493 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.873579 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.873810 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.873898 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.874128 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.874223 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.874463 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.874550 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.874786 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.874874 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.875104 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.875201 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.875422 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.875525 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.875756 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.875854 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.876084 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.876179 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.876457 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.876544 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.876783 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.876873 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.877097 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.877192 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.877407 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.877494 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.877716 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.877805 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.878103 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.878195 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.878414 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.878501 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.878725 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.878812 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.879039 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.879127 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.879354 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.879448 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.879721 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.879826 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.880048 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.880136 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.880355 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.880442 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.880663 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.880757 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.880911 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:36:26.881007 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.881343 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.881680 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.882069 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.882400 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.882757 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.883068 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.883374 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:36:26.883636 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:36:26.943990 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO dbcounter [None req-57085940-539d-469c-a831-e19cf6435daf None None] Registered counter for database nova_api Jul 18 16:36:26.947915 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO dbcounter [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Registered counter for database nova_api Jul 18 16:36:27.058154 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_db.sqlalchemy.engines [None req-57085940-539d-469c-a831-e19cf6435daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:36:27.062510 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG oslo_db.sqlalchemy.engines [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:36:27.064677 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writer thread running {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:36:27.068936 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writer thread running {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:36:27.121156 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.context [None req-57085940-539d-469c-a831-e19cf6435daf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ba72f21f-270b-4889-a6c4-a2b12cf658e1(cell1) {{(pid=110373) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:36:27.124582 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.context [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ba72f21f-270b-4889-a6c4-a2b12cf658e1(cell1) {{(pid=110372) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:36:27.125053 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-57085940-539d-469c-a831-e19cf6435daf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:36:27.126654 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-57085940-539d-469c-a831-e19cf6435daf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:36:27.127428 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-57085940-539d-469c-a831-e19cf6435daf None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:36:27.128521 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG oslo_concurrency.lockutils [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:36:27.129590 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-57085940-539d-469c-a831-e19cf6435daf None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:36:27.130080 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG oslo_concurrency.lockutils [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:36:27.130872 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG oslo_concurrency.lockutils [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:36:27.131566 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO dbcounter [None req-57085940-539d-469c-a831-e19cf6435daf None None] Registered counter for database nova_cell0 Jul 18 16:36:27.132989 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG oslo_concurrency.lockutils [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:36:27.134967 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO dbcounter [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Registered counter for database nova_cell0 Jul 18 16:36:27.135893 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO dbcounter [None req-57085940-539d-469c-a831-e19cf6435daf None None] Registered counter for database nova_cell1 Jul 18 16:36:27.139631 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO dbcounter [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Registered counter for database nova_cell1 Jul 18 16:36:27.143665 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_db.sqlalchemy.engines [None req-57085940-539d-469c-a831-e19cf6435daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:36:27.149233 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_db.sqlalchemy.engines [None req-57085940-539d-469c-a831-e19cf6435daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:36:27.149364 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG oslo_db.sqlalchemy.engines [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:36:27.149631 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG oslo_db.sqlalchemy.engines [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:36:27.150452 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writer thread running {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:36:27.152515 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writer thread running {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:36:27.156443 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writer thread running {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:36:27.158453 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writer thread running {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:36:27.300205 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO dbcounter [None req-57085940-539d-469c-a831-e19cf6435daf None None] Registered counter for database nova_cell0 Jul 18 16:36:27.305887 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO dbcounter [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Registered counter for database nova_cell0 Jul 18 16:36:27.309262 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_db.sqlalchemy.engines [None req-57085940-539d-469c-a831-e19cf6435daf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:36:27.313736 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writer thread running {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:36:27.314656 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG oslo_db.sqlalchemy.engines [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:36:27.319145 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writer thread running {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:36:27.747552 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: WARNING keystonemiddleware.auth_token [None req-57085940-539d-469c-a831-e19cf6435daf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:36:27.756584 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: WARNING keystonemiddleware.auth_token [None req-57085940-539d-469c-a831-e19cf6435daf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:36:27.778852 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: WARNING keystonemiddleware.auth_token [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:36:27.786291 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: WARNING keystonemiddleware.auth_token [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:36:28.101605 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: WARNING keystonemiddleware.auth_token [None req-57085940-539d-469c-a831-e19cf6435daf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:36:28.109319 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: WARNING keystonemiddleware.auth_token [None req-57085940-539d-469c-a831-e19cf6435daf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:36:28.116081 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d3289f9c0 pid: 110373 (default app) Jul 18 16:36:28.118847 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-57085940-539d-469c-a831-e19cf6435daf None None] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:36:28.120735 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-57085940-539d-469c-a831-e19cf6435daf None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002517 Jul 18 16:36:28.121149 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Mon Jul 18 16:36:28 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:36:28.131101 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: WARNING keystonemiddleware.auth_token [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:36:28.137895 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: WARNING keystonemiddleware.auth_token [None req-78ce5d35-7df0-408a-b009-05557c17d217 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:36:28.143195 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d3289f9c0 pid: 110372 (default app) Jul 18 16:37:49.992990 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-57085940-539d-469c-a831-e19cf6435daf None None] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:37:49.994018 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-57085940-539d-469c-a831-e19cf6435daf None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 18 16:37:49.994364 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:37:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:37:50.006874 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_api:SELECT=3 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:50.007972 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_cell0:SELECT=3 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:50.008794 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_cell1:SELECT=3 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:50.009917 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:50.889270 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-6ac44b75-5bf0-458e-a361-7ab560d63144 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:37:50.919821 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-6ac44b75-5bf0-458e-a361-7ab560d63144 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918504 Jul 18 16:37:50.920754 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 18 16:37:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:37:53.177685 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-57085940-539d-469c-a831-e19cf6435daf None None] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:37:53.179233 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-57085940-539d-469c-a831-e19cf6435daf None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 18 16:37:53.179963 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:37:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:37:53.678405 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-feb2447f-6719-46ee-9647-58fdc9fab9c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "disk": 1}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:37:53.697110 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:37:53.697110 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: warnings.warn(msg) Jul 18 16:37:53.830565 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-feb2447f-6719-46ee-9647-58fdc9fab9c2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.642747 Jul 18 16:37:53.830565 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:37:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:37:53.843963 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=3 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:53.845395 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell1:SELECT=3 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:53.846245 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell0:SELECT=3 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:53.847040 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:37:54.056380 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-6f0505fa-4f1e-4234-9a7a-f055e1be2688 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:37:54.058807 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:37:54.058807 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 18 16:37:54.224889 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-6f0505fa-4f1e-4234-9a7a-f055e1be2688 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.385748 Jul 18 16:37:54.225916 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 18 16:37:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:37:56.474560 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-feb2447f-6719-46ee-9647-58fdc9fab9c2 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:37:56.476375 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-feb2447f-6719-46ee-9647-58fdc9fab9c2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002123 Jul 18 16:37:56.476967 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:37:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:37:57.159112 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-6f0a5683-cf1d-4898-a1d3-7e34df3c62df admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:37:57.179857 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:37:57.179857 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 18 16:37:57.299116 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-6f0a5683-cf1d-4898-a1d3-7e34df3c62df admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.815164 Jul 18 16:37:57.299695 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:37:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:37:57.312653 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-845e1284-5659-452e-893f-c3a05d8b9f55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:37:57.314270 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:37:57.314270 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: warnings.warn(msg) Jul 18 16:37:57.427210 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-845e1284-5659-452e-893f-c3a05d8b9f55 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118179 Jul 18 16:37:57.428308 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 18 16:37:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:37:59.701966 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-6f0a5683-cf1d-4898-a1d3-7e34df3c62df admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:37:59.703001 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-6f0a5683-cf1d-4898-a1d3-7e34df3c62df admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 18 16:37:59.703613 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:00.112257 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-9c964e77-c493-4574-adad-601c666949bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:00.194076 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-9c964e77-c493-4574-adad-601c666949bf admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484589 Jul 18 16:38:00.194740 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:37:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:38:00.207052 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-ad2a628e-b1fe-42b7-8e9f-46541eecebe1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:00.363735 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-ad2a628e-b1fe-42b7-8e9f-46541eecebe1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160719 Jul 18 16:38:00.364316 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 18 16:38:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:38:02.773134 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-9c964e77-c493-4574-adad-601c666949bf admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:02.775417 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-9c964e77-c493-4574-adad-601c666949bf admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002704 Jul 18 16:38:02.776482 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:38:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:03.250084 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-fdb6bbcc-a8a4-4ab6-840d-8def9ae99ce3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "name": "ds2G", "swap": 0}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:03.344944 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-fdb6bbcc-a8a4-4ab6-840d-8def9ae99ce3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.560111 Jul 18 16:38:03.346302 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:38:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:03.359833 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-37adf872-ff94-48b0-886f-9d5371df766f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:03.472517 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-37adf872-ff94-48b0-886f-9d5371df766f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116427 Jul 18 16:38:03.473493 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 18 16:38:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:38:05.733792 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-fdb6bbcc-a8a4-4ab6-840d-8def9ae99ce3 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:05.734798 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-fdb6bbcc-a8a4-4ab6-840d-8def9ae99ce3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 18 16:38:05.735764 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:38:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:38:06.195512 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-eb1c05aa-accd-47d7-809e-991f22650705 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "id": "d4", "name": "ds4G", "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:06.297455 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-eb1c05aa-accd-47d7-809e-991f22650705 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.554392 Jul 18 16:38:06.305896 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:38:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:38:06.311152 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-b8e8709e-b8fd-44f0-9050-1f9b5b88d647 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:06.432415 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-b8e8709e-b8fd-44f0-9050-1f9b5b88d647 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125057 Jul 18 16:38:06.432950 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jul 18 16:38:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:38:08.697362 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-eb1c05aa-accd-47d7-809e-991f22650705 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:08.698412 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-eb1c05aa-accd-47d7-809e-991f22650705 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 18 16:38:08.698776 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:38:09.382200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-cd71971f-4c3a-4a50-beb7-0a8a395fa65a admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:09.415373 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-cd71971f-4c3a-4a50-beb7-0a8a395fa65a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.710282 Jul 18 16:38:09.416821 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 18 16:38:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:38:11.722700 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-eb1c05aa-accd-47d7-809e-991f22650705 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:11.722700 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-eb1c05aa-accd-47d7-809e-991f22650705 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jul 18 16:38:11.722700 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:38:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:12.160594 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-053cf16b-d55e-48c4-9f08-44e70c6176b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "ram": 512}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:12.266869 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-053cf16b-d55e-48c4-9f08-44e70c6176b1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.539155 Jul 18 16:38:12.267730 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:38:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:12.280522 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-e679eb4c-b791-4098-8651-7ff471afebc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:12.371431 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-e679eb4c-b791-4098-8651-7ff471afebc6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094554 Jul 18 16:38:12.372362 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 18 16:38:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:38:14.602941 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-053cf16b-d55e-48c4-9f08-44e70c6176b1 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:14.604098 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-053cf16b-d55e-48c4-9f08-44e70c6176b1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Jul 18 16:38:14.604769 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:38:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:15.013321 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-9eacf6aa-76ae-4105-ab94-5c5a0d34892f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "ram": 2048}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:15.131600 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-9eacf6aa-76ae-4105-ab94-5c5a0d34892f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.519904 Jul 18 16:38:15.131907 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:38:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:15.143919 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-49873064-48fe-4a2c-ab98-9faeace28739 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:15.266289 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-49873064-48fe-4a2c-ab98-9faeace28739 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126118 Jul 18 16:38:15.266926 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 18 16:38:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:38:17.516175 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-9eacf6aa-76ae-4105-ab94-5c5a0d34892f admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:17.517206 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-9eacf6aa-76ae-4105-ab94-5c5a0d34892f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jul 18 16:38:17.517613 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:38:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:17.884137 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-2374f496-2d6d-445e-afa9-0df4185933cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "swap": 0}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:18.045352 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-2374f496-2d6d-445e-afa9-0df4185933cb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.520899 Jul 18 16:38:18.045946 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:38:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:18.058590 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-31dfaa81-3d4c-4138-8700-530ce75816e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:18.186880 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-31dfaa81-3d4c-4138-8700-530ce75816e9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131993 Jul 18 16:38:18.187857 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 18 16:38:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:38:20.545054 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-2374f496-2d6d-445e-afa9-0df4185933cb admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:20.546191 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-2374f496-2d6d-445e-afa9-0df4185933cb admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Jul 18 16:38:20.546646 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:21.025930 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1775481a-1c40-4cd9-a6bc-1c6d51cdc25f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:21.030558 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:38:21.303012 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-1775481a-1c40-4cd9-a6bc-1c6d51cdc25f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.748085 Jul 18 16:38:21.303582 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:38:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:21.316183 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-26980e23-e682-4d1a-8f8a-898ebdfa349b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:21.434852 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-26980e23-e682-4d1a-8f8a-898ebdfa349b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122499 Jul 18 16:38:21.435692 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 18 16:38:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:38:23.747231 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1775481a-1c40-4cd9-a6bc-1c6d51cdc25f admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:23.748270 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-1775481a-1c40-4cd9-a6bc-1c6d51cdc25f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jul 18 16:38:23.749118 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:38:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:24.199901 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-ed5ddb6f-e8d0-45c9-aa16-7dfd82094cb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "ram": 16384, "id": "5", "vcpus": 8}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:24.311921 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-ed5ddb6f-e8d0-45c9-aa16-7dfd82094cb6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.556813 Jul 18 16:38:24.312841 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jul 18 16:38:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:24.325289 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-afc4a595-120d-487f-b7c7-9606f516bc30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:24.442275 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-afc4a595-120d-487f-b7c7-9606f516bc30 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120474 Jul 18 16:38:24.445555 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jul 18 16:38:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:38:45.612174 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-ed5ddb6f-e8d0-45c9-aa16-7dfd82094cb6 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:45.613360 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-ed5ddb6f-e8d0-45c9-aa16-7dfd82094cb6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jul 18 16:38:45.613760 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:38:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:45.624776 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:38:46.019970 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-841462f7-0f93-4247-aa52-e9d611e5c922 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:46.038720 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-841462f7-0f93-4247-aa52-e9d611e5c922 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.418174 Jul 18 16:38:46.039128 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 18 16:38:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:38:47.127618 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-ed5ddb6f-e8d0-45c9-aa16-7dfd82094cb6 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:47.128608 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-ed5ddb6f-e8d0-45c9-aa16-7dfd82094cb6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 18 16:38:47.128998 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:38:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:47.656046 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-28f6725b-067e-45be-9559-de215528846d admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:47.662205 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.wsgi [None req-28f6725b-067e-45be-9559-de215528846d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-28f6725b-067e-45be-9559-de215528846d admin admin] Request method failure captured: Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Accept: application/json Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Accept-Encoding: gzip, deflate Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Connection: keep-alive Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Content-Length: 0 Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Host: 10.222.0.26 Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Openstack-Api-Version: compute 2.90 Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Openstack-System-Scope: None Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: User-Agent: python-novaclient Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Auth-Token: gAAAAABi1YyXZCkmue0hKqVIQTZkrdhbjl79LeUkGdDQPbk4ONG0NFWTQsGGeQlStrfWwHF2eN2O94Y5e6-GtnrluNRB7F-vCtHHF4PlTTCVtjiBOsoxrkQES27SO0huKshj7cRRJFXbm9x_HY7OZ77r5ERAEWeOWHP2pz-9cRye08WxJJy5kzY Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Domain-Id: None Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Domain-Name: None Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Identity-Status: Confirmed Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Is-Admin-Project: True Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Domain-Id: default Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Domain-Name: Default Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Name: admin Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Role: member,reader,admin Jul 18 16:38:47.665534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Roles: member,reader,admin Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e08d80b293148beac001ab7796d9842", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e08d80b293148beac001ab7796d9842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}] Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Tenant: admin Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Tenant-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Tenant-Name: admin Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User: admin Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Domain-Id: default Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Domain-Name: Default Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Id: e18df28d16ba462694258c7ad963170a Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Name: admin Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: method: > Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: exception: Flavor 42 could not be found. Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: action_args: {'id': '42'} Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:38:47.667154 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:47.668086 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.669244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-28f6725b-067e-45be-9559-de215528846d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:38:47.670357 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-28f6725b-067e-45be-9559-de215528846d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398876 Jul 18 16:38:47.670357 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 18 16:38:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:38:47.677062 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-751f6735-4538-4645-a98a-ace80eda70da admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:47.679987 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:38:47.698271 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-751f6735-4538-4645-a98a-ace80eda70da admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025235 Jul 18 16:38:47.698825 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 18 16:38:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:38:47.709646 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-63cb02bc-f583-4d6f-a251-e48eb5b00bbf admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:47.731519 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-63cb02bc-f583-4d6f-a251-e48eb5b00bbf admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026390 Jul 18 16:38:47.732087 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 18 16:38:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:38:47.741687 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-db4f7f60-0bd8-477b-b26a-236990d0a652 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:47.747801 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.wsgi [None req-db4f7f60-0bd8-477b-b26a-236990d0a652 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-db4f7f60-0bd8-477b-b26a-236990d0a652 admin admin] Request method failure captured: Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Accept: application/json Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Accept-Encoding: gzip, deflate Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Connection: keep-alive Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Content-Length: 0 Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Host: 10.222.0.26 Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Openstack-Api-Version: compute 2.90 Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Openstack-System-Scope: None Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: User-Agent: python-novaclient Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Auth-Token: gAAAAABi1YyXZCkmue0hKqVIQTZkrdhbjl79LeUkGdDQPbk4ONG0NFWTQsGGeQlStrfWwHF2eN2O94Y5e6-GtnrluNRB7F-vCtHHF4PlTTCVtjiBOsoxrkQES27SO0huKshj7cRRJFXbm9x_HY7OZ77r5ERAEWeOWHP2pz-9cRye08WxJJy5kzY Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Domain-Id: None Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Domain-Name: None Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Identity-Status: Confirmed Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Is-Admin-Project: True Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Domain-Id: default Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Domain-Name: Default Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Name: admin Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Role: member,reader,admin Jul 18 16:38:47.751200 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Roles: member,reader,admin Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e08d80b293148beac001ab7796d9842", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e08d80b293148beac001ab7796d9842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}] Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Tenant: admin Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Tenant-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Tenant-Name: admin Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User: admin Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Domain-Id: default Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Domain-Name: Default Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Id: e18df28d16ba462694258c7ad963170a Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Name: admin Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: method: > Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: exception: Flavor 42 could not be found. Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: action_args: {'id': '42'} Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:38:47.757482 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:47.758445 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:47.759744 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-db4f7f60-0bd8-477b-b26a-236990d0a652 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:38:47.760950 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-db4f7f60-0bd8-477b-b26a-236990d0a652 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014746 Jul 18 16:38:47.760950 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 18 16:38:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:38:48.749791 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-63cb02bc-f583-4d6f-a251-e48eb5b00bbf admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:48.750886 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-63cb02bc-f583-4d6f-a251-e48eb5b00bbf admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jul 18 16:38:48.751320 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:38:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:49.289264 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-7cdbbbbc-0a13-4c26-8a5e-89a79a9c29b9 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:49.294658 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.wsgi [None req-7cdbbbbc-0a13-4c26-8a5e-89a79a9c29b9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-7cdbbbbc-0a13-4c26-8a5e-89a79a9c29b9 admin admin] Request method failure captured: Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Accept: application/json Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Accept-Encoding: gzip, deflate Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Connection: keep-alive Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Content-Length: 0 Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Host: 10.222.0.26 Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Openstack-Api-Version: compute 2.90 Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Openstack-System-Scope: None Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: User-Agent: python-novaclient Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Auth-Token: gAAAAABi1YyYiRvQKooZj4HxX8KdMI_BWQiraKglitAO8pYDGiwUKwPJtAjv0AFf_lsZlDZJFapTOTgIeDxpDMb-gpy2BRQLYqQu9_QGleH_KC32apt5Ml3zY3yD6jVpqdXWaJhxZjamBV1GYdF1gbfhf3znjVdzzfbq1BDgmYC5HpsQPxWT0Hg Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Domain-Id: None Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Domain-Name: None Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Identity-Status: Confirmed Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Is-Admin-Project: True Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Domain-Id: default Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Domain-Name: Default Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Name: admin Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Role: member,reader,admin Jul 18 16:38:49.296187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Roles: member,reader,admin Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e08d80b293148beac001ab7796d9842", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e08d80b293148beac001ab7796d9842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}] Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Tenant: admin Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Tenant-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Tenant-Name: admin Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User: admin Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Domain-Id: default Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Domain-Name: Default Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Id: e18df28d16ba462694258c7ad963170a Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Name: admin Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: method: > Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: exception: Flavor 84 could not be found. Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: action_args: {'id': '84'} Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:38:49.297749 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:49.298824 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.300202 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-7cdbbbbc-0a13-4c26-8a5e-89a79a9c29b9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:38:49.301715 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-7cdbbbbc-0a13-4c26-8a5e-89a79a9c29b9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.406285 Jul 18 16:38:49.301715 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 18 16:38:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:38:49.307566 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-54256a26-d2ba-4685-b4cd-8fc95224cd78 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:49.321481 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-54256a26-d2ba-4685-b4cd-8fc95224cd78 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017576 Jul 18 16:38:49.322023 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 18 16:38:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:38:49.331539 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-bd2c0c5a-69a2-4108-8b69-f98cb1cd5bab admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:49.346187 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-bd2c0c5a-69a2-4108-8b69-f98cb1cd5bab admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018151 Jul 18 16:38:49.346701 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 18 16:38:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:38:49.356064 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-edd6e5c5-25de-43d8-83c7-8d42d1197fe9 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:49.361282 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.wsgi [None req-edd6e5c5-25de-43d8-83c7-8d42d1197fe9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-edd6e5c5-25de-43d8-83c7-8d42d1197fe9 admin admin] Request method failure captured: Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Accept: application/json Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Accept-Encoding: gzip, deflate Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Connection: keep-alive Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Content-Length: 0 Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Host: 10.222.0.26 Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Openstack-Api-Version: compute 2.90 Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Openstack-System-Scope: None Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: User-Agent: python-novaclient Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Auth-Token: gAAAAABi1YyYiRvQKooZj4HxX8KdMI_BWQiraKglitAO8pYDGiwUKwPJtAjv0AFf_lsZlDZJFapTOTgIeDxpDMb-gpy2BRQLYqQu9_QGleH_KC32apt5Ml3zY3yD6jVpqdXWaJhxZjamBV1GYdF1gbfhf3znjVdzzfbq1BDgmYC5HpsQPxWT0Hg Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Domain-Id: None Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Domain-Name: None Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Identity-Status: Confirmed Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Is-Admin-Project: True Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Domain-Id: default Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Domain-Name: Default Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Name: admin Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Role: member,reader,admin Jul 18 16:38:49.362771 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Roles: member,reader,admin Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e08d80b293148beac001ab7796d9842", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e08d80b293148beac001ab7796d9842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}] Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Tenant: admin Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Tenant-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Tenant-Name: admin Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User: admin Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Domain-Id: default Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Domain-Name: Default Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Id: e18df28d16ba462694258c7ad963170a Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Name: admin Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: method: > Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: exception: Flavor 84 could not be found. Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: action_args: {'id': '84'} Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:38:49.364373 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:49.365239 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:49.366520 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-edd6e5c5-25de-43d8-83c7-8d42d1197fe9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:38:49.367779 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-edd6e5c5-25de-43d8-83c7-8d42d1197fe9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011580 Jul 18 16:38:49.367779 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jul 18 16:38:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 16:38:50.372335 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-bd2c0c5a-69a2-4108-8b69-f98cb1cd5bab admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:50.373412 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-bd2c0c5a-69a2-4108-8b69-f98cb1cd5bab admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 18 16:38:50.373806 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:38:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:50.912639 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-5e35e0d4-0040-4562-be0e-5f295e7a7c3d admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:50.918419 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.wsgi [None req-5e35e0d4-0040-4562-be0e-5f295e7a7c3d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-5e35e0d4-0040-4562-be0e-5f295e7a7c3d admin admin] Request method failure captured: Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Accept: application/json Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Accept-Encoding: gzip, deflate Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Connection: keep-alive Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Content-Length: 0 Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Host: 10.222.0.26 Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Openstack-Api-Version: compute 2.90 Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Openstack-System-Scope: None Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: User-Agent: python-novaclient Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Auth-Token: gAAAAABi1YyaaeZMw90t5GXLHY-3VA_9jjtcsq8Xlu4yTAQLS-uhQm1M5xkTKU_qfcJ6Gx-LD1NM6Vv3R2HZ1QLSFSl8EkzpZTdZfwyrR9Y2CF6G-uYng-zwrg_SaaDdLR7kAxtF2wyzPvYO7lnjzc4roxPI2MKQ6C9MYNJ3ymtqG0_vB2zt1R0 Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Domain-Id: None Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Domain-Name: None Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Identity-Status: Confirmed Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Is-Admin-Project: True Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Domain-Id: default Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Domain-Name: Default Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Project-Name: admin Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Role: member,reader,admin Jul 18 16:38:50.921032 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Roles: member,reader,admin Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e08d80b293148beac001ab7796d9842", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e08d80b293148beac001ab7796d9842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}] Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Tenant: admin Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Tenant-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-Tenant-Name: admin Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User: admin Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Domain-Id: default Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Domain-Name: Default Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Id: e18df28d16ba462694258c7ad963170a Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: X-User-Name: admin Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: method: > Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: exception: Flavor 451 could not be found. Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: action_args: {'id': '451'} Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:38:50.922539 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:50.923514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.924789 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-5e35e0d4-0040-4562-be0e-5f295e7a7c3d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:38:50.926302 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-5e35e0d4-0040-4562-be0e-5f295e7a7c3d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.405201 Jul 18 16:38:50.926302 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 18 16:38:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:38:50.931423 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-5350fddb-ec28-41c9-80b6-ff229aa9d3cc admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:50.945822 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-5350fddb-ec28-41c9-80b6-ff229aa9d3cc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017996 Jul 18 16:38:50.946353 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 18 16:38:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:38:50.955792 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:50.971514 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019295 Jul 18 16:38:50.972057 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jul 18 16:38:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 16:38:50.986346 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-3a45e4fb-e356-4532-9d7e-1ce089b1a7ba admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:50.992128 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.wsgi [None req-3a45e4fb-e356-4532-9d7e-1ce089b1a7ba admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-3a45e4fb-e356-4532-9d7e-1ce089b1a7ba admin admin] Request method failure captured: Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Accept: application/json Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Accept-Encoding: gzip, deflate Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Connection: keep-alive Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Content-Length: 0 Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Host: 10.222.0.26 Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Openstack-Api-Version: compute 2.90 Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Openstack-System-Scope: None Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: User-Agent: python-novaclient Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Auth-Token: gAAAAABi1YyaaeZMw90t5GXLHY-3VA_9jjtcsq8Xlu4yTAQLS-uhQm1M5xkTKU_qfcJ6Gx-LD1NM6Vv3R2HZ1QLSFSl8EkzpZTdZfwyrR9Y2CF6G-uYng-zwrg_SaaDdLR7kAxtF2wyzPvYO7lnjzc4roxPI2MKQ6C9MYNJ3ymtqG0_vB2zt1R0 Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Domain-Id: None Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Domain-Name: None Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Identity-Status: Confirmed Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Is-Admin-Project: True Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Domain-Id: default Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Domain-Name: Default Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Project-Name: admin Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Role: member,reader,admin Jul 18 16:38:50.993587 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Roles: member,reader,admin Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e08d80b293148beac001ab7796d9842", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e08d80b293148beac001ab7796d9842"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e08d80b293148beac001ab7796d9842"}]}] Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Tenant: admin Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Tenant-Id: 9e08d80b293148beac001ab7796d9842 Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-Tenant-Name: admin Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User: admin Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Domain-Id: default Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Domain-Name: Default Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Id: e18df28d16ba462694258c7ad963170a Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: X-User-Name: admin Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: method: > Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: exception: Flavor 451 could not be found. Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: action_args: {'id': '451'} Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:38:50.995171 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:50.996111 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 18 16:38:50.997167 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-3a45e4fb-e356-4532-9d7e-1ce089b1a7ba admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:38:50.998173 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-3a45e4fb-e356-4532-9d7e-1ce089b1a7ba admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012087 Jul 18 16:38:50.998173 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 18 16:38:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 16:38:51.981818 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:51.982856 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 18 16:38:51.983313 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:52.516285 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-6582c860-8138-4c4e-b341-7b2112a75f1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:52.610858 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-6582c860-8138-4c4e-b341-7b2112a75f1d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.489357 Jul 18 16:38:52.611402 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 18 16:38:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:53.609204 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:53.610194 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 18 16:38:53.610584 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:38:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:54.144468 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-de78dcf6-f5ea-4d85-a497-e8e58a9eb131 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:54.234695 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-de78dcf6-f5ea-4d85-a497-e8e58a9eb131 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.483531 Jul 18 16:38:54.235256 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 18 16:38:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:55.229177 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:55.230471 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 18 16:38:55.230583 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:38:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:55.758610 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-1dfc2126-5901-4378-ba52-ca7f3cf9528a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:55.845588 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-1dfc2126-5901-4378-ba52-ca7f3cf9528a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.472886 Jul 18 16:38:55.846134 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 18 16:38:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:56.860124 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:56.861121 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 18 16:38:56.861534 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:38:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:57.396890 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-bc3e9d86-4bec-464a-a5e2-deb4f3920094 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:38:57.523281 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-bc3e9d86-4bec-464a-a5e2-deb4f3920094 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.520350 Jul 18 16:38:57.523854 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jul 18 16:38:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:38:58.511085 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:58.512114 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 18 16:38:58.512504 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:38:59.044052 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-d9cf2e92-1731-47d8-a1f0-128ebaf72811 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:38:59.063388 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-d9cf2e92-1731-47d8-a1f0-128ebaf72811 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410873 Jul 18 16:38:59.064054 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Mon Jul 18 16:38:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:52.985544 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:52.986547 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4c677500-5ba9-4a94-8809-d7b12b7ec7f1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 18 16:39:52.986966 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jul 18 16:39:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:39:52.997860 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:53.399179 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-2ff66c29-4578-4de5-9612-9cda84300303 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:53.418850 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-2ff66c29-4578-4de5-9612-9cda84300303 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.425426 Jul 18 16:39:53.419323 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jul 18 16:39:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:39:53.441010 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_api:SELECT=14 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:39:53.445681 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1eab7930-c6ad-4f31-a0d3-4d85a7aaa1e1 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:53.453244 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-1eab7930-c6ad-4f31-a0d3-4d85a7aaa1e1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013760 Jul 18 16:39:53.456742 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jul 18 16:39:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:53.465621 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-3d7020df-c002-4860-bec5-6d107efd89c7 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:53.474116 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-3d7020df-c002-4860-bec5-6d107efd89c7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011987 Jul 18 16:39:53.474623 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jul 18 16:39:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:39:53.486391 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:53.494768 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012300 Jul 18 16:39:53.495292 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jul 18 16:39:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:39:53.508408 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-5e7af746-ac44-4ff0-942b-c820f4426a93 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:39:53.517861 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-5e7af746-ac44-4ff0-942b-c820f4426a93 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014555 Jul 18 16:39:53.518427 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jul 18 16:39:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:43:42.487384 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:42.488420 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 18 16:43:42.488813 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:42.633628 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=6 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:42.797912 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-ade8b666-4db7-4222-a49d-9d71ade3a8e7 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:42.799114 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:43:42.799114 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 18 16:43:42.800366 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-ade8b666-4db7-4222-a49d-9d71ade3a8e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:42.800844 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-ade8b666-4db7-4222-a49d-9d71ade3a8e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:42.801616 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-ade8b666-4db7-4222-a49d-9d71ade3a8e7 admin admin] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:42.802049 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-ade8b666-4db7-4222-a49d-9d71ade3a8e7 admin admin] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:42.838642 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-ade8b666-4db7-4222-a49d-9d71ade3a8e7 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.206563 Jul 18 16:43:42.843464 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 18 16:43:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 16:43:43.710263 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:43.711333 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002046 Jul 18 16:43:43.711762 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:43.916760 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-f9990f5d-4b57-4d05-bb75-73c96d719ad3 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:43.917947 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:43:43.917947 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 18 16:43:43.919050 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-f9990f5d-4b57-4d05-bb75-73c96d719ad3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:43.919507 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-f9990f5d-4b57-4d05-bb75-73c96d719ad3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:43.920303 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-f9990f5d-4b57-4d05-bb75-73c96d719ad3 admin admin] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:43.920735 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-f9990f5d-4b57-4d05-bb75-73c96d719ad3 admin admin] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:43.940894 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-f9990f5d-4b57-4d05-bb75-73c96d719ad3 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086789 Jul 18 16:43:43.941473 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 18 16:43:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 16:43:55.226893 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:55.227945 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jul 18 16:43:55.228371 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:55.376662 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell0:SELECT=4 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:55.377399 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell1:SELECT=4 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:55.378027 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=8 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:55.429241 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-60c8f7e5-5877-4f9a-8422-c63aff1184fb admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:55.430216 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:43:55.430216 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 18 16:43:55.431405 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-60c8f7e5-5877-4f9a-8422-c63aff1184fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:55.431882 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-60c8f7e5-5877-4f9a-8422-c63aff1184fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:55.432673 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-60c8f7e5-5877-4f9a-8422-c63aff1184fb admin admin] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:55.433182 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-60c8f7e5-5877-4f9a-8422-c63aff1184fb admin admin] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:55.459876 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-60c8f7e5-5877-4f9a-8422-c63aff1184fb admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087618 Jul 18 16:43:55.464043 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 18 16:43:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:43:56.305674 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:56.306680 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-8cb74f26-9882-4a8b-85c9-744996bb6ad4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 18 16:43:56.307081 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jul 18 16:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:43:56.505578 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-bc123182-143c-4c3b-8a7a-a92ab8fcbeeb admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:43:56.507206 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:43:56.507206 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 18 16:43:56.508514 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-bc123182-143c-4c3b-8a7a-a92ab8fcbeeb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:56.508958 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-bc123182-143c-4c3b-8a7a-a92ab8fcbeeb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:56.509753 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-bc123182-143c-4c3b-8a7a-a92ab8fcbeeb admin admin] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:43:56.510177 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-bc123182-143c-4c3b-8a7a-a92ab8fcbeeb admin admin] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:43:56.532624 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-bc123182-143c-4c3b-8a7a-a92ab8fcbeeb admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084379 Jul 18 16:43:56.533104 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jul 18 16:43:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 16:44:53.657667 dv-cinder-846172-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 16:44:53.658287 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: Mon Jul 18 16:44:53 2022 - graceful shutdown triggered... Jul 18 16:44:53.658866 dv-cinder-846172-3-iscsi devstack@n-api.service[110372]: Gracefully killing worker 1 (pid: 110372)... Jul 18 16:44:53.659368 dv-cinder-846172-3-iscsi devstack@n-api.service[110373]: Gracefully killing worker 2 (pid: 110373)... Jul 18 16:44:54.659377 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: worker 1 buried after 1 seconds Jul 18 16:44:54.659377 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: worker 2 buried after 1 seconds Jul 18 16:44:54.660063 dv-cinder-846172-3-iscsi devstack@n-api.service[110371]: goodbye to uWSGI. Jul 18 16:44:54.660997 dv-cinder-846172-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 16:44:54.661567 dv-cinder-846172-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 16:44:54.665026 dv-cinder-846172-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 16:44:54.675088 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:44:54 2022] *** Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: nodename: dv-cinder-846172-3-iscsi Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: machine: x86_64 Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: clock source: unix Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: pcre jit disabled Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: detected number of CPU cores: 4 Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: current working directory: / Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:44:54.677133 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: your processes number limit is 47680 Jul 18 16:44:54.677838 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: your memory page size is 4096 bytes Jul 18 16:44:54.677838 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: detected max file descriptor number: 2048 Jul 18 16:44:54.677838 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: lock engine: pthread robust mutexes Jul 18 16:44:54.677838 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: thunder lock: enabled Jul 18 16:44:54.677838 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 16:44:54.677838 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:44:54.719475 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: Python main interpreter initialized at 0x55654ff6f9c0 Jul 18 16:44:54.719475 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: python threads support enabled Jul 18 16:44:54.719475 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: your server socket listen backlog is limited to 100 connections Jul 18 16:44:54.719475 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:44:54.719965 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:44:54.719965 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: *** Operational MODE: preforking *** Jul 18 16:44:54.720223 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:44:54.720223 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: spawned uWSGI master process (pid: 124926) Jul 18 16:44:54.720455 dv-cinder-846172-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 16:44:54.721020 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: spawned uWSGI worker 1 (pid: 124944, cores: 1) Jul 18 16:44:54.727950 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: spawned uWSGI worker 2 (pid: 124945, cores: 1) Jul 18 16:44:54.728300 dv-cinder-846172-3-iscsi devstack@n-api.service[124926]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:44:55.393694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:44:55.404343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 16:44:56.571979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:44:56.571979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: from cryptography.utils import int_from_bytes Jul 18 16:44:56.572831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:44:56.572831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: from cryptography.utils import int_from_bytes Jul 18 16:44:56.581367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:44:56.581367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: from cryptography.utils import int_from_bytes Jul 18 16:44:56.581918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:44:56.581918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: from cryptography.utils import int_from_bytes Jul 18 16:44:58.941840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:44:58.942431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:44:58.942709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:44:58.942999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:44:58.943260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:44:58.943370 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:44:58.943979 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:44:58.944573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.944778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.945033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:44:58.945213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.945551 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:44:58.945654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.945816 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:44:58.945908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.946198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.946306 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.946510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.946628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.946844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.946943 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.947175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.947282 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.947448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.947693 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.947852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.948002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.948183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-3-iscsi {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.948290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.948510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.948675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.948816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.948964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.949115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.949267 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.949435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.949589 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.949749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.949899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-3-iscsi {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.950049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.950196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.950354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.950502 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.950720 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.950874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.951073 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.951336 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.951695 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.952004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.952520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.952816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.952984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.953146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.953373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.953539 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.953750 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.953948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.954123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.954364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.954539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.954701 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.954985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.955168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.955330 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.955627 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.955796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.956035 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-3-iscsi {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.956209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.956443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.956657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.956836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.957009 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.957179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.957848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.958039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.958186 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.958339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-3-iscsi {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.958494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.958666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.958823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.958823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.959113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.959254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.959412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.959676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.959899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.960055 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.960197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.960338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.960479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.960634 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.960782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.960929 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.961070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.961210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.961372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.961541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.961692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.961834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.961974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.962120 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.962120 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.962407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.962549 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.962701 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.962868 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.963159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.963611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.963862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.964332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.964484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.964626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.964804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.964994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.965242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.965390 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.965541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.965682 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.965833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.966002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.966246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.966402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.966543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.966697 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.966857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.967006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.967147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.967302 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.967478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.967853 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.968008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.968170 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.968311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.968470 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.968612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.968770 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.968912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.969073 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.969217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.969364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.969504 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.969654 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.969805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.969957 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.970104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.970255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.970396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.970396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.970678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.970678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.970960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.971108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.971256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.971406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.971585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.971732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.971893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.972043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.972197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.972338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.972488 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.972635 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.972807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.972962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.973142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.973285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.973426 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.973724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.973878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.974037 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.974387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.974622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.974771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.974922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.975071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.975232 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.975461 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.975626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.975777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.975918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.976066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.976235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.976506 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.976667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.976812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.976953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.977118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.977277 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.977435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.977584 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.977884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.978041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.978183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.978332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.978494 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.978634 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.978775 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.978915 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.979056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.979210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.979351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.979535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.979684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.979834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.979984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.980125 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.980265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.980415 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.980556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.980705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.980884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.981033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.981174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.981323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.981464 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.981611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.981814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.981970 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.982122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.982278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.982431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.982582 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.983891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.984062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.984208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.984623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.984882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.985029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.985187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.985489 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.985731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.985878 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.986076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.986234 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.986393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.986647 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.986805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.987031 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.987175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.987323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.987463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.987628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.987986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.988149 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.988299 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.988461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.988610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.988813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.988960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.989119 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.989348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.989574 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.990047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.990306 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.990555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.991293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.991624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.991863 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.992115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.992385 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.992623 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.992807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.992960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.993111 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.993253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.993404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.993560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.993710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.994102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.994262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.994411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.994828 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.995120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.995270 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.995420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.995597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.995758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.996012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:58.996178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.996322 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:58.996473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.997649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:58.997896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.998382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:58.998639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.999099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:58.999338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.999338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:58.999826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.000042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:44:59.000248 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.000248 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.000662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.000777 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.000880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.000972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001408 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001560 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001782 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.001952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.002104 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.002222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.002370 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.002533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.002622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.002712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.002849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.002952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003045 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003624 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.003986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.004148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.004375 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.004500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.004610 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.004846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.005115 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.005357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.005475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.005590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.005699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.005822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.005948 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.006125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.006246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.007089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.007265 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.007439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.007660 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.007867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.007981 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008111 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008198 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008570 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008659 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008742 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008920 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.008920 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.009260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.009345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.009443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.009541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.009624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.009705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.009786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.009874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.009963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010054 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010225 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010660 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.010998 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011170 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011813 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.011993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012615 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.012957 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013134 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013395 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013570 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.013996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.014083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.014164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.014253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.014353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.014488 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.014586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.014685 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.014775 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.014887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.015125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.015268 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.015376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.015720 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.015829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.015904 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.015988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016685 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.016966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017590 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.017962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018138 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018789 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.018950 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019357 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019536 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019886 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.019974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020579 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020857 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.020946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021045 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021224 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021400 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.021856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.022524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.022758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.022879 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.023525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.023683 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.023683 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.023841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.023923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.023995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.024272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.024384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.024531 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.024630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.024848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.024976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.025165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.025289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.025495 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.025590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.025810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.025921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.026131 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.026238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.026444 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.026548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.026769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.026872 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.027082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.027177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.027393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.027519 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.027725 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.027832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.028045 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.028142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.028363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.028457 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.028686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.028806 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.029017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.029117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.029331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.029428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.029641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.029739 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.029966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.030071 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.030287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.030382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.030618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.030740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.030965 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.031083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.031324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.031471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.031674 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.031788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.032003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.032157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.032363 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.032462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.032677 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.032783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.033030 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.033278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.033397 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.033642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.033814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.033973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.034066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.034332 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.034459 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.034660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.034785 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.035087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.035188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.035403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.035518 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.035745 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.035853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.036072 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.036163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.036387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.036476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.036697 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.036798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.037011 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.037110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.037320 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.037411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.038207 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.038361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.038612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.038714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.038798 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.039021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.039111 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.039343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.039562 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.039699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.039792 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.040018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.040172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.040350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.040436 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.040636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.040735 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.040945 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.041102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.041256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.041353 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.041571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.041670 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.041883 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.041997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.042197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.042285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.042511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.042609 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.042823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.042972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.043146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.043244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.043470 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.043676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.043804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.043907 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.044109 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.044205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.044416 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.044508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.044723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.044814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.045042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.045131 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.045369 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.045458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.045675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.045814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.045988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.046076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.046298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.046387 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.046608 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.046707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.046924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.047012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.047232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.047321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.047563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.047677 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.047876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.047974 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.048188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.048286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.048498 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.048590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.048811 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.048919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.049127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.049228 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.049437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.049533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.049763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.049866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.050069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.050219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.050380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.050492 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.050717 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.050817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.051070 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.051208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.051384 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.051538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.051746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.052078 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.052534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.052695 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.052861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.053011 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.053191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.053343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.053634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.053807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.053963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.054113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.054257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.054397 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.054552 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.054722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.054885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.055028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.055176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.055352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.055558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.055720 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.055871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.056023 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.056166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.056314 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.056578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.056735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.056883 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.057017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.057186 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.057339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.057495 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.057665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.057792 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.057995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.058095 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.058320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.058417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.058657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.058757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.058982 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.059071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.059287 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.059376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.059625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.059779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.059934 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.060083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.060346 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.060573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.060696 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.060813 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.060921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.061036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.061187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.061312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.061512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.061709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.061850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.062021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.062130 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.062339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.062491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.062648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.062796 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.062959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.063104 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.063261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.063432 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.063589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.063800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.063907 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.064107 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.064197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.064411 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.064509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.064733 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.064833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.065038 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.065143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.065597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.065703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.065903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.066012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.066214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.066312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.066522 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.066622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.066826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.066966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.067136 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.067230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.067446 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.067620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.067781 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.067886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.068091 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.068189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.068396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.068508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.068705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.068837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.069127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.069230 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.069437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.069681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.069940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.070039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.070254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.070403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.070577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.070700 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.070892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.071006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.071199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.071330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.071522 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.071635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.071839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.071928 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.072144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.072235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.072455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.072559 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.072761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.072855 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.073067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.073177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.073371 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.073469 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.073681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.073780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.073989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.074084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.074292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.074390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.074594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.074684 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.074910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.075009 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.075212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.075316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.075535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.075674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.075850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.075943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.076154 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.076253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.076458 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.076549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.076764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.076865 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.077072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.077202 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.077377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.077475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.077689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.077778 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.078000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.078092 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.078304 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.078400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.078611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.078711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.078922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.079013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.079229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.079338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.079553 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.079666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.079860 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.079951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.080164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.080260 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.080465 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.080568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.080774 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.080898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.081098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.081258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.081406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.081545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.081708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.081798 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.082083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.082226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.082393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.082590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.082758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.083067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.083474 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.083726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.083872 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.084048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.084174 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.084898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.085048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.085339 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.085484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.085774 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.085910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.086022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.086131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.086239 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.086358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.086506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.086625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.086816 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.087179 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.087440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.087772 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.088096 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.088409 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.088721 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.089043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.089370 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.089694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.090000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.090274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.090376 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.090647 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.090759 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.090958 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.091047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.091326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.091430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.091683 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.091802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.092036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.092149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.092375 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.092579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.092726 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.092962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.093070 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.093290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.093383 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.093623 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.093725 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.093932 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.094034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.094242 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.094336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.094547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.094649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.094870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.094971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.095237 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.095330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.095594 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.095710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.095913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.096018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.096221 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.096326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.096549 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.096655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.096894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.097094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.097341 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.097449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.097683 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.097789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.097995 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.098100 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.098303 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.098400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.098612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.098709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.098923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.099029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.099243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.099340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.099584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.099681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.099910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.100061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.100878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.101424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.101520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.101602 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.101681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.101857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.101994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.102210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.102362 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.102581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.102722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.103028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.103294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.103437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.103744 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.103943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.104079 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.104306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.104455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.104652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.104745 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.105045 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.105145 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.105371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.105470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.105714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.105816 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.106063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.106163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.106384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.106485 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.106699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.106842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.107020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.107136 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.107354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.107536 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.107702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.107818 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.108018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.108128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.108351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.108461 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.108657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.108762 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.108974 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.109079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.109284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.109391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.109612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.109713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.109935 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.110031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.110246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.110351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.110563 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.110667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.110870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.110975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.111192 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.111289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.111524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.111624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.111844 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.111942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.112169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.112289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.112549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.112708 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.112862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.112962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.113211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.113317 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.113499 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.113593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.113812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.113918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.114121 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.114210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.114426 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.114517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.114738 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.114831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.115081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.115236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.115351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.115451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.115729 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.115847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.116035 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.116172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.116344 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.116487 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.116656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.116920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.117068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.117241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.117361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.117550 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.117640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.117917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.118087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.118204 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.118291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.118467 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.118567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.118805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.119819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.119926 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120798 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.120963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.121053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.121215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.121307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.121563 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.121691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.121914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.122024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.122210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.122311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.122518 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.122623 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.122913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.123509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.123617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.123719 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.123856 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.124083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.124233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.124356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.124466 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.124575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.124776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.125107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.125406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.125531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.125734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.125835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.126050 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.126148 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.126360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.126464 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.126675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.126779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.127658 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.127806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.127806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.127969 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.128044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.128044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.128526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.128526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.128703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.129192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.129284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.129357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.129426 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.129512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.129800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.129921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.130004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.130076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.130431 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.130542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.130624 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.130696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.130981 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.131079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.131921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.132022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.132220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.132851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.132931 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.133002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.133094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.133176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.133255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.133326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.133597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.133713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.133935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.134038 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.134252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.134354 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.134578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.134684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.134911 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.135013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.135225 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.135316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.135569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.135742 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.135889 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.135979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.136207 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.136306 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.136517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.136623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.136833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.136923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.137140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.137237 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.137451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.137551 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.137768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.137937 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.138095 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.138255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.138433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.138592 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.139105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.139275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.139424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.139608 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.139779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.139939 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.140155 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.140334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.140497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.140648 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.140828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.140991 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.141140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.141300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.141456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.141615 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.141801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.142034 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.142195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.142354 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.142512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.142669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.142829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.142995 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.143148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.143368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.143556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.143727 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.143888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.144097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.144264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.144414 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.144563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.144730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.144881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.145029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.145179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.145327 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.145476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.145638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.145809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.145965 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.146124 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.146280 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.146446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.146596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.146745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.146926 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.147774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.148167 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.148514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.148683 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.148854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.149008 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.149151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.149304 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.149460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.149611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.149769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.149910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.150048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.150197 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.150344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.150769 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.150927 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.151099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.151259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.151627 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.151791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.151959 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.152112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.152291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.152511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.153026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.153297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.153508 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.153721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.153921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.154132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.154347 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.154549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.154765 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.154960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.154960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.155338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.155338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.155751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.155955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.156151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.156344 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.156564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.156786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.156982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.157173 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.157379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.157601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.157793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.158003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.158365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.158789 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.158983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.159199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.159410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.159599 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.159811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.160020 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.160221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.160430 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.160659 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.161135 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.161343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.163418 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.163689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.163980 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.164213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.164440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.164649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.164864 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.165082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.165082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.165472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.165730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.165928 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.166143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.166355 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.166550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.166763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.166959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.167163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.167389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.167607 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.167817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.168026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.168026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.168550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.168923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.169129 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.169329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.169531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.169782 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.169977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.170512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.170729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.170947 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.171423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.171854 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.171854 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.172263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.172460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.172671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.172876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.173082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.173082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.173757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.173951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.174155 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.174366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.174585 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.174797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.175004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.175211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.175414 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.175663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.175877 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.176190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.176385 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.176597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.176800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.177004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.177210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.177210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.177593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.177790 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.177990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.178173 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.178377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.178710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.178710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.179193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.179380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.179636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.179870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.180133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.180387 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.180643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.180913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.181194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.181751 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.182009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.182009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.182559 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.182834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.183100 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.183100 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.183790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.183790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.184451 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.184706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.184984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.185251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.185511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.185779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.186035 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.186452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.186721 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.186977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.187243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.187535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.187808 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.188062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.188062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.188577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.189154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.189410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.189662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.189913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.190194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.190714 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.190981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.191223 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.191727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.192019 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.192289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.192558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.192825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.193076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.193345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.193613 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.194914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.195179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.195451 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.195765 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.196043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.196296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.196554 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.196554 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.197033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.197292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.197560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.197814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.197814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.198321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.198586 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.198852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.199353 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.199653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.199653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.200198 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.200481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.200752 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.201019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.201270 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.201523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.202059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.202352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.202625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.202885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.203195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.203459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.203764 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.204051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.204321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.204321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.205070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.205348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.205654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.206767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.207028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.207283 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.207591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.207852 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.208128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.208404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.208656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.208918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.209206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.210293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.210565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.210846 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.211102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.211376 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.211690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.212214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.212499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.212761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.213030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.213294 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.213812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.214064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.214335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.214641 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.216066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.216347 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.216609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.216874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.217146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.217403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.217661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.217928 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.218191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.218461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.218713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.219984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.220278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.220648 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.220906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.220906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.221415 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.221415 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.221919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.222193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.222768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.223042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.223300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.223594 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.223892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.224162 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.224435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.224686 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.224983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.225390 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.225648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.225903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.226363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.226633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.226901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.227156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.227405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.227750 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.228039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.228298 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.228544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.228805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.229067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.229332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.229579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.229819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.230244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.230505 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.230930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.231235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.231516 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.231794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.232049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.232049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.232882 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.233260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.233533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.233803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.234057 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.234328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.234590 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.234872 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.235174 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.235953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.236222 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.236716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.236985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.237255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.237529 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.237769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.238014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.238242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.238482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.238703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.238955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.239204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.239457 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.239760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.240021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.240475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.240749 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.241194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.241460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.241744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.242021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.242272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.242522 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.243169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.243444 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.243757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.244024 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.244285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.244539 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.244805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.245067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.245377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.245635 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.245930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.246350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.246607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.248112 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.248410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.248684 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.248944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.249215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.249475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.249759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.250035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.250296 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.250776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.251049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.251481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.251833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.252151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.252406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.252672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.252954 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.253561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.253842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.254103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.254361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.254616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.257366 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.257717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.258455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.258764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.259044 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.259314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.259620 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.259926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.260200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.260461 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.260759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.261167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.261457 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.261875 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.262151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.262435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.262697 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.262971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.263229 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.263982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.264256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.264527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.264777 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.265074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.265354 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.265631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.265631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.266187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.266510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.266766 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.267058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.267469 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.267738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.268004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.268253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.268730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.269020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.269290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.269547 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.269804 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.270072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.270319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.270877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.271167 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.271606 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.272624 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.273142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.273417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:44:59.273682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.273682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.273682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.273682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.273682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.273682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.273682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.273682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.276011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.276011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.276011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.276011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.276011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.276011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.276011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.276011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.278174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.278174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.278174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.278174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.278174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.278174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.278174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.278174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.280403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:44:59.280403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:44:59.370607 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO dbcounter [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Registered counter for database nova_api Jul 18 16:44:59.376897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO dbcounter [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Registered counter for database nova_api Jul 18 16:44:59.393368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_db.sqlalchemy.engines [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:44:59.398340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_db.sqlalchemy.engines [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:44:59.401766 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writer thread running {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:44:59.406270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writer thread running {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:44:59.461336 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.context [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ba72f21f-270b-4889-a6c4-a2b12cf658e1(cell1) {{(pid=124945) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:44:59.464993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.context [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ba72f21f-270b-4889-a6c4-a2b12cf658e1(cell1) {{(pid=124944) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 16:44:59.465166 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.466668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.467480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.469118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.469620 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.470624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.471443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:44:59.471702 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO dbcounter [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Registered counter for database nova_cell0 Jul 18 16:44:59.473459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:44:59.477193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO dbcounter [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Registered counter for database nova_cell1 Jul 18 16:44:59.478509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO dbcounter [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Registered counter for database nova_cell0 Jul 18 16:44:59.482956 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO dbcounter [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Registered counter for database nova_cell1 Jul 18 16:44:59.485885 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_db.sqlalchemy.engines [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:44:59.486195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_db.sqlalchemy.engines [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:44:59.490335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_db.sqlalchemy.engines [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:44:59.493444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_db.sqlalchemy.engines [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:44:59.493832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writer thread running {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:44:59.496102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writer thread running {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:44:59.497243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writer thread running {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:44:59.634408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writer thread running {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:44:59.642156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO dbcounter [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Registered counter for database nova_cell0 Jul 18 16:44:59.644697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO dbcounter [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Registered counter for database nova_cell0 Jul 18 16:44:59.650972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_db.sqlalchemy.engines [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:44:59.652311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_db.sqlalchemy.engines [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:44:59.655686 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writer thread running {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:44:59.656653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writer thread running {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:44:59.974678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: WARNING keystonemiddleware.auth_token [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:44:59.982368 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: WARNING keystonemiddleware.auth_token [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:44:59.984986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: WARNING keystonemiddleware.auth_token [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:44:59.993810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: WARNING keystonemiddleware.auth_token [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:45:00.344074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: WARNING keystonemiddleware.auth_token [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:45:00.350853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: WARNING keystonemiddleware.auth_token [None req-91221692-af33-4680-ac0d-05a0105f2285 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:45:00.356645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55654ff6f9c0 pid: 124944 (default app) Jul 18 16:45:00.362174 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: WARNING keystonemiddleware.auth_token [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 16:45:00.368820 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: WARNING keystonemiddleware.auth_token [None req-7730296c-f71a-4ae4-810f-a2e8c68f12a2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 16:45:00.374568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55654ff6f9c0 pid: 124945 (default app) Jul 18 16:45:44.483289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=3 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:44.484804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=3 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:44.485714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=3 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:44.486625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=3 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:44.623390 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=3 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:44.625206 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=3 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:44.626241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=3 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:44.627294 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=3 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:46.783935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-52900010-51e6-4cc0-99d2-b860fb757c44 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Action: 'create', calling method: .version_select at 0x7fd6b0038820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1822529325"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-97fabd86-0673-4d1a-8f4f-9197fb1c4779 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Action: 'create', calling method: .version_select at 0x7fd6b0038820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-419341230", "metadata": {"Type": "work"}}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-97fabd86-0673-4d1a-8f4f-9197fb1c4779 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Request method failure captured: Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 121 Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y44GCOvJktsHpU7etlnrW-tMnOOp41Pu_zTF2neWRzY0HQk6SBWSiEAAPK1hErSd-EIFxHady8VTGKSw4uvQRemSiUzAKzAsguMHWRH2H5UorQ7p-nilkItk6Q_QfmMjfIf4WWDIfsG5so6kEmqCGhv6cj97POjuzr96pVN5nhYUXk Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:45:46.789780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47f8e892e9284e2f926d1a23b80f0a5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}] Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: 0a36d1f2e0b1457b81946ed9af4c05b0 Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-419341230", "metadata": {"Type": "work"}}} Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: Jul 18 16:45:46.800761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-419341230', 'metadata': {'Type': 'work'}}}} Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:46.815263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:45:46.833076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:45:46.838520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 16:45:46.838520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.838520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-97fabd86-0673-4d1a-8f4f-9197fb1c4779 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:46.838520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-97fabd86-0673-4d1a-8f4f-9197fb1c4779 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.093724 Jul 18 16:45:46.838520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 18 16:45:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 16:45:46.838520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-07db2ef1-a4d0-4f68-a071-71029d275864 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Action: 'create', calling method: .version_select at 0x7fd6affbcaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-785755768", "metadata": {"Type": "work"}}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:46.838520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-07db2ef1-a4d0-4f68-a071-71029d275864 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Request method failure captured: Jul 18 16:45:46.838520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:45:46.838520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 119 Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y44GCOvJktsHpU7etlnrW-tMnOOp41Pu_zTF2neWRzY0HQk6SBWSiEAAPK1hErSd-EIFxHady8VTGKSw4uvQRemSiUzAKzAsguMHWRH2H5UorQ7p-nilkItk6Q_QfmMjfIf4WWDIfsG5so6kEmqCGhv6cj97POjuzr96pVN5nhYUXk Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:45:46.839899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47f8e892e9284e2f926d1a23b80f0a5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}] Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: 0a36d1f2e0b1457b81946ed9af4c05b0 Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-785755768", "metadata": {"Type": "work"}}} Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-785755768', 'metadata': {'Type': 'work'}}}} Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi '0' Jul 18 16:45:46.844643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.853254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-07db2ef1-a4d0-4f68-a071-71029d275864 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-07db2ef1-a4d0-4f68-a071-71029d275864 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032945 Jul 18 16:45:46.855687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 2/2] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 18 16:45:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-090f36d3-7122-4050-9b7d-c7455fad091a tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Action: 'create', calling method: .version_select at 0x7fd6b0038b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-472643787", "metadata": {"Type": "work"}}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-090f36d3-7122-4050-9b7d-c7455fad091a tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Request method failure captured: Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 118 Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y44GCOvJktsHpU7etlnrW-tMnOOp41Pu_zTF2neWRzY0HQk6SBWSiEAAPK1hErSd-EIFxHady8VTGKSw4uvQRemSiUzAKzAsguMHWRH2H5UorQ7p-nilkItk6Q_QfmMjfIf4WWDIfsG5so6kEmqCGhv6cj97POjuzr96pVN5nhYUXk Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:45:46.858076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47f8e892e9284e2f926d1a23b80f0a5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}] Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: 0a36d1f2e0b1457b81946ed9af4c05b0 Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-472643787", "metadata": {"Type": "work"}}} Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: Jul 18 16:45:46.860605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-472643787', 'metadata': {'Type': 'work'}}}} Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise error Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi '' Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:46.861955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 16:45:46.864278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 16:45:46.867672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 16:45:46.867672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:46.867672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-090f36d3-7122-4050-9b7d-c7455fad091a tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:46.867672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-090f36d3-7122-4050-9b7d-c7455fad091a tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008343 Jul 18 16:45:46.867672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 3/3] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 18 16:45:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 16:45:46.867672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f6704a2f-478e-4496-b914-f3c9f5827738 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Calling method '.version_select at 0x7fd6aff66820>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:47.425296 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-f6704a2f-478e-4496-b914-f3c9f5827738 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] HTTP exception thrown: Volume tempest-invalid-1762721388 could not be found. Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f6704a2f-478e-4496-b914-f3c9f5827738 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Request method failure captured: Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1762721388 HTTP/1.1 Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y44GCOvJktsHpU7etlnrW-tMnOOp41Pu_zTF2neWRzY0HQk6SBWSiEAAPK1hErSd-EIFxHady8VTGKSw4uvQRemSiUzAKzAsguMHWRH2H5UorQ7p-nilkItk6Q_QfmMjfIf4WWDIfsG5so6kEmqCGhv6cj97POjuzr96pVN5nhYUXk Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:45:47.428301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47f8e892e9284e2f926d1a23b80f0a5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}] Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: 0a36d1f2e0b1457b81946ed9af4c05b0 Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Volume tempest-invalid-1762721388 could not be found. Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'id': 'tempest-invalid-1762721388'} Jul 18 16:45:47.434622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1762721388 could not be found. (HTTP 404) (Request-ID: req-f6a7ffbc-f37f-46bb-8af2-448333e87cea) Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:47.436062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:45:47.437850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1762721388 could not be found. Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:45:47.439758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1762721388 could not be found. Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1762721388 could not be found. Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f6704a2f-478e-4496-b914-f3c9f5827738 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Returning 404 to user: Volume tempest-invalid-1762721388 could not be found. {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f6704a2f-478e-4496-b914-f3c9f5827738 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1762721388" status: 404 len: 99 microversion: 2.1 time: 0.640450 Jul 18 16:45:47.440949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 4/4] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 18 16:45:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1762721388 => generated 99 bytes in 642 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:45:47.442184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ed8dcd3d-0a3d-4012-a306-7287a0ac75a3 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005643 Jul 18 16:45:47.453458 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 5/5] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jul 18 16:45:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 16:45:47.465699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b2838523-3781-45de-b0ef-d737c53f98bf tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008152 Jul 18 16:45:47.472185 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 6/6] 10.222.0.26 () {58 vars in 1136 bytes} [Mon Jul 18 16:45:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 16:45:47.478013 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec4ae031-b58a-4317-8ccb-e40c3f67e418 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Calling method '.version_select at 0x7fd6afe97af0>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:47.738973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-ec4ae031-b58a-4317-8ccb-e40c3f67e418 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] HTTP exception thrown: Volume e6d32273-7e0e-4a1e-a999-588b6c429662 could not be found. Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec4ae031-b58a-4317-8ccb-e40c3f67e418 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Request method failure captured: Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: DELETE /compute/v2.1/os-volumes/e6d32273-7e0e-4a1e-a999-588b6c429662 HTTP/1.1 Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y44GCOvJktsHpU7etlnrW-tMnOOp41Pu_zTF2neWRzY0HQk6SBWSiEAAPK1hErSd-EIFxHady8VTGKSw4uvQRemSiUzAKzAsguMHWRH2H5UorQ7p-nilkItk6Q_QfmMjfIf4WWDIfsG5so6kEmqCGhv6cj97POjuzr96pVN5nhYUXk Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:45:47.741556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47f8e892e9284e2f926d1a23b80f0a5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}] Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: 0a36d1f2e0b1457b81946ed9af4c05b0 Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Volume e6d32273-7e0e-4a1e-a999-588b6c429662 could not be found. Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'id': 'e6d32273-7e0e-4a1e-a999-588b6c429662'} Jul 18 16:45:47.743388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6d32273-7e0e-4a1e-a999-588b6c429662 could not be found. (HTTP 404) (Request-ID: req-712bfe35-39bd-47bc-9414-86cf9a8b32c6) Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:47.744041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:45:47.750953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6d32273-7e0e-4a1e-a999-588b6c429662 could not be found. Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:45:47.751842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6d32273-7e0e-4a1e-a999-588b6c429662 could not be found. Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6d32273-7e0e-4a1e-a999-588b6c429662 could not be found. Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec4ae031-b58a-4317-8ccb-e40c3f67e418 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Returning 404 to user: Volume e6d32273-7e0e-4a1e-a999-588b6c429662 could not be found. {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ec4ae031-b58a-4317-8ccb-e40c3f67e418 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/e6d32273-7e0e-4a1e-a999-588b6c429662" status: 404 len: 109 microversion: 2.1 time: 0.270312 Jul 18 16:45:47.753712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 7/7] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 16:45:47 2022] DELETE /compute/v2.1/os-volumes/e6d32273-7e0e-4a1e-a999-588b6c429662 => generated 109 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:45:47.755237 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8fbf95f8-2245-4792-a82c-ef9da6c97f90 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Calling method '.version_select at 0x7fd6afe97670>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:48.510495 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-8fbf95f8-2245-4792-a82c-ef9da6c97f90 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] HTTP exception thrown: Volume ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8 could not be found. Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8fbf95f8-2245-4792-a82c-ef9da6c97f90 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Request method failure captured: Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: GET /compute/v2.1/os-volumes/ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8 HTTP/1.1 Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y44GCOvJktsHpU7etlnrW-tMnOOp41Pu_zTF2neWRzY0HQk6SBWSiEAAPK1hErSd-EIFxHady8VTGKSw4uvQRemSiUzAKzAsguMHWRH2H5UorQ7p-nilkItk6Q_QfmMjfIf4WWDIfsG5so6kEmqCGhv6cj97POjuzr96pVN5nhYUXk Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:45:48.513705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_47f8e892e9284e2f926d1a23b80f0a5c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/47f8e892e9284e2f926d1a23b80f0a5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/47f8e892e9284e2f926d1a23b80f0a5c"}]}] Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 47f8e892e9284e2f926d1a23b80f0a5c Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesNegativeTest-1177666944 Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: 0a36d1f2e0b1457b81946ed9af4c05b0 Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesNegativeTest-1177666944-project Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Volume ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8 could not be found. Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'id': 'ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8'} Jul 18 16:45:48.515201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8 could not be found. (HTTP 404) (Request-ID: req-e2bf394f-213a-417f-810f-165e8651e21f) Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:48.516097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:45:48.517453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8 could not be found. Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:45:48.518527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8 could not be found. Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8 could not be found. Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8fbf95f8-2245-4792-a82c-ef9da6c97f90 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] Returning 404 to user: Volume ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8 could not be found. {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8fbf95f8-2245-4792-a82c-ef9da6c97f90 tempest-VolumesNegativeTest-1177666944 tempest-VolumesNegativeTest-1177666944-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8" status: 404 len: 109 microversion: 2.1 time: 0.768798 Jul 18 16:45:48.519656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 8/8] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:45:47 2022] GET /compute/v2.1/os-volumes/ffc469dd-f292-4fe1-8fa6-ad9cda44ffe8 => generated 109 bytes in 770 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:45:48.670881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-52900010-51e6-4cc0-99d2-b860fb757c44 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.196339 Jul 18 16:45:48.671978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1/9] 10.222.0.26 () {60 vars in 1154 bytes} [Mon Jul 18 16:45:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4199 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 16:45:48.685814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0a4d07c2-ed72-4475-b640-9eeac7b529c7 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6afe979d0>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:48.878187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0a4d07c2-ed72-4475-b640-9eeac7b529c7 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f" status: 200 len: 345 microversion: 2.1 time: 0.197343 Jul 18 16:45:48.884694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 9/10] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:45:48 2022] GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f => generated 345 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:49.897195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5b3c621f-bf00-471d-8289-dd427f2a8afe tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6aff07670>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:50.035136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5b3c621f-bf00-471d-8289-dd427f2a8afe tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f" status: 200 len: 345 microversion: 2.1 time: 0.143144 Jul 18 16:45:50.041051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 2/11] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:45:49 2022] GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:51.049500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3382cd3f-789c-40f6-9680-f0cd3eda5efe tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6aff07790>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:51.125528 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-740691964", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "networks": [{"uuid": "b0dddbd3-0b01-4228-8f34-49c0f8218db3"}]}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:51.156407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3382cd3f-789c-40f6-9680-f0cd3eda5efe tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f" status: 200 len: 346 microversion: 2.1 time: 0.109715 Jul 18 16:45:51.156407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 3/12] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:45:51 2022] GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:51.185338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8bd7255e-2839-4c5f-9d57-7e5c7f738690 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Action: 'create', calling method: .version_select at 0x7fd6aff07d30>, body: {"snapshot": {"volume_id": "8e5d075f-ea1b-4bca-a58f-65464226c80f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1267030828"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:45:51.372819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.network.neutron [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] validate_networks() for [('b0dddbd3-0b01-4228-8f34-49c0f8218db3', None, None, None, None, None)] {{(pid=124945) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:45:52.248803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8bd7255e-2839-4c5f-9d57-7e5c7f738690 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.077221 Jul 18 16:45:52.254333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 4/13] 10.222.0.26 () {60 vars in 1161 bytes} [Mon Jul 18 16:45:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:52.262566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8e44028e-104a-4ebd-9176-450566675389 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6aff1a9d0>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:52.378269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8e44028e-104a-4ebd-9176-450566675389 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547" status: 200 len: 287 microversion: 2.1 time: 0.122469 Jul 18 16:45:52.379934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 5/14] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 18 16:45:52 2022] GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:52.392455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6712c357-bb52-4d14-8230-6029c3b19fda tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6aff07d30>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:52.500073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6712c357-bb52-4d14-8230-6029c3b19fda tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.113761 Jul 18 16:45:52.501486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 6/15] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jul 18 16:45:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:52.516217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f1216101-edf1-4c9f-b8b3-4830bd7a2562 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6aff1aa60>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:52.598811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f1216101-edf1-4c9f-b8b3-4830bd7a2562 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547" status: 200 len: 287 microversion: 2.1 time: 0.090865 Jul 18 16:45:52.605218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 7/16] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 18 16:45:52 2022] GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:53.621532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8f90859e-bc96-47fd-957a-6eab5e7510b8 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6aff1a280>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:53.624547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Flavor limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:45:53.625340 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Image limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:45:53.626206 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Flavor pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:45:53.626645 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Image pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:45:53.627687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:45:53.739140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:53.739587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:53.745846 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:53.746305 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:53.904085 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Getting quotas for project 540cf87ca5364bf598ab16cdc3903a1c. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:45:53.942190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Getting quotas for user 87094997b3b94ebea3de60446795fb7a and project 540cf87ca5364bf598ab16cdc3903a1c. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:45:53.982833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Going to run 1 instances... {{(pid=124945) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:45:53.986317 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:45:54.104517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8f90859e-bc96-47fd-957a-6eab5e7510b8 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547" status: 200 len: 287 microversion: 2.1 time: 0.496602 Jul 18 16:45:54.105075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 8/17] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 18 16:45:53 2022] GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547 => generated 287 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:54.302325 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4d09165b-2f95-4b6f-a1cc-5d242a9eae61 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.485919 Jul 18 16:45:54.304022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 10/18] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 16:45:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:45:54.314043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-55b13ff1-eb29-4100-a996-7a1c209cd253 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:54.315010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-55b13ff1-eb29-4100-a996-7a1c209cd253 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:54.537042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-55b13ff1-eb29-4100-a996-7a1c209cd253 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:54.572538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-55b13ff1-eb29-4100-a996-7a1c209cd253 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1214 microversion: 2.1 time: 0.261220 Jul 18 16:45:54.574619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 9/19] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:54 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:55.149198 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c2b94f0f-13fe-484d-80bd-3bd652310935 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6afd98790>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:55.224393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c2b94f0f-13fe-484d-80bd-3bd652310935 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547" status: 200 len: 287 microversion: 2.1 time: 0.079941 Jul 18 16:45:55.225419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 11/20] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 18 16:45:55 2022] GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547 => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:55.594697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2da1ec52-bf55-4982-99d3-9728b578e0f0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:55.595847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2da1ec52-bf55-4982-99d3-9728b578e0f0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:55.910934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2da1ec52-bf55-4982-99d3-9728b578e0f0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:55.924911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2da1ec52-bf55-4982-99d3-9728b578e0f0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1214 microversion: 2.1 time: 0.338257 Jul 18 16:45:55.932595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:55 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1214 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:56.242300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c3272d01-e367-4c43-87f7-3cdfadf65798 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6afd98ee0>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:56.304624 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c3272d01-e367-4c43-87f7-3cdfadf65798 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547" status: 200 len: 288 microversion: 2.1 time: 0.069350 Jul 18 16:45:56.317934 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 12/22] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 18 16:45:56 2022] GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547 => generated 288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:56.318120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-def6ef14-699f-43f7-91f8-ec8fbc753c10 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6afeed8b0>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:56.953329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e9dcc888-4eb1-4cf5-bd73-fd64a5023e2e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:56.954512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e9dcc888-4eb1-4cf5-bd73-fd64a5023e2e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:56.978477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-def6ef14-699f-43f7-91f8-ec8fbc753c10 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547" status: 202 len: 0 microversion: 2.1 time: 0.665320 Jul 18 16:45:56.979560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1253 bytes} [Mon Jul 18 16:45:56 2022] DELETE /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547 => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:45:56.987573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bf38fc93-8a4c-401f-9fdf-b46b10e4939e tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6afeedaf0>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:57.224282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bf38fc93-8a4c-401f-9fdf-b46b10e4939e tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547" status: 200 len: 287 microversion: 2.1 time: 0.240566 Jul 18 16:45:57.225730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 18 16:45:56 2022] GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547 => generated 287 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:45:57.246445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e9dcc888-4eb1-4cf5-bd73-fd64a5023e2e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:57.275128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e9dcc888-4eb1-4cf5-bd73-fd64a5023e2e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1214 microversion: 2.1 time: 0.331920 Jul 18 16:45:57.284720 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:56 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:58.240636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f8e95e59-0bb0-42e1-aae4-d2c8b75d1768 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6afeedee0>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:58.300814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-407e30a0-46b2-45c8-96ae-5031d84d2410 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:58.303013 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-407e30a0-46b2-45c8-96ae-5031d84d2410 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:58.318880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-407e30a0-46b2-45c8-96ae-5031d84d2410 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:58.319460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-407e30a0-46b2-45c8-96ae-5031d84d2410 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:58.321362 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-407e30a0-46b2-45c8-96ae-5031d84d2410 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:58.321900 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-407e30a0-46b2-45c8-96ae-5031d84d2410 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:58.648708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-f8e95e59-0bb0-42e1-aae4-d2c8b75d1768 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] HTTP exception thrown: Snapshot a577d025-f472-423b-9c11-7691d300b547 could not be found. Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f8e95e59-0bb0-42e1-aae4-d2c8b75d1768 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Request method failure captured: Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547 HTTP/1.1 Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y44sK-HP-xHRe9agCVjRSixtx2-IwS9QnMT8rhRk4W0_aodlQvalZY0LnnIXs14hLSMSOPFiriMuHgiSsCOotRvRHikphQLB7DooPfTi53xBUAfXpaaXUUKUqVMQ0txY441gP4krd678eMNEKnZgh-ZJV4XIGMDsEQlZJzbUfVcLOU Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 1893db2223fc4395a202c5124c94fdf8 Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 16:45:58.653016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1893db2223fc4395a202c5124c94fdf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1893db2223fc4395a202c5124c94fdf8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1893db2223fc4395a202c5124c94fdf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1893db2223fc4395a202c5124c94fdf8"}]}] Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 1893db2223fc4395a202c5124c94fdf8 Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-VolumesSnapshotsTestJSON-1426416081-project Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: d6cfe76f2e98474f802171dbf7a61244 Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1426416081-project Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Snapshot a577d025-f472-423b-9c11-7691d300b547 could not be found. Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'a577d025-f472-423b-9c11-7691d300b547'} Jul 18 16:45:58.654462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a577d025-f472-423b-9c11-7691d300b547 could not be found. (HTTP 404) (Request-ID: req-0e458db1-f1e8-411e-b3c6-7dbe8c485e13) Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:45:58.655334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:45:58.656739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a577d025-f472-423b-9c11-7691d300b547 could not be found. Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 16:45:58.657943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a577d025-f472-423b-9c11-7691d300b547 could not be found. Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a577d025-f472-423b-9c11-7691d300b547 could not be found. Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f8e95e59-0bb0-42e1-aae4-d2c8b75d1768 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Returning 404 to user: Snapshot a577d025-f472-423b-9c11-7691d300b547 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:45:58.659270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f8e95e59-0bb0-42e1-aae4-d2c8b75d1768 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547" status: 404 len: 111 microversion: 2.1 time: 0.421091 Jul 18 16:45:58.660237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 18 16:45:58 2022] GET /compute/v2.1/os-snapshots/a577d025-f472-423b-9c11-7691d300b547 => generated 111 bytes in 422 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:45:58.672768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-003cd811-c45c-48ef-9524-36daa6ddb1cd tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6b08e9b80>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:58.863585 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-407e30a0-46b2-45c8-96ae-5031d84d2410 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:45:58.888166 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-407e30a0-46b2-45c8-96ae-5031d84d2410 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1210 microversion: 2.1 time: 0.591397 Jul 18 16:45:58.889833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:58 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1210 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:45:59.115099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-003cd811-c45c-48ef-9524-36daa6ddb1cd tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f" status: 202 len: 0 microversion: 2.1 time: 0.455224 Jul 18 16:45:59.116508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 16:45:58 2022] DELETE /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:45:59.126356 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0716e7d3-75a0-41ce-bd1e-9baa3756718a tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6aecce670>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:59.208951 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0716e7d3-75a0-41ce-bd1e-9baa3756718a tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f" status: 200 len: 345 microversion: 2.1 time: 0.087792 Jul 18 16:45:59.209894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:45:59 2022] GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f => generated 345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:45:59.906740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4160282b-9942-4790-adb3-9a4360add5a1 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:45:59.910987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4160282b-9942-4790-adb3-9a4360add5a1 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:45:59.921256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4160282b-9942-4790-adb3-9a4360add5a1 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:59.926903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4160282b-9942-4790-adb3-9a4360add5a1 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:45:59.934843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4160282b-9942-4790-adb3-9a4360add5a1 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:45:59.935583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4160282b-9942-4790-adb3-9a4360add5a1 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:00.223916 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a6a52b21-55e6-4381-8c8a-3cecafc8b6c6 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6aecce700>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:00.291820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4160282b-9942-4790-adb3-9a4360add5a1 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:00.292494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-a6a52b21-55e6-4381-8c8a-3cecafc8b6c6 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] HTTP exception thrown: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a6a52b21-55e6-4381-8c8a-3cecafc8b6c6 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Request method failure captured: Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f HTTP/1.1 Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y44sK-HP-xHRe9agCVjRSixtx2-IwS9QnMT8rhRk4W0_aodlQvalZY0LnnIXs14hLSMSOPFiriMuHgiSsCOotRvRHikphQLB7DooPfTi53xBUAfXpaaXUUKUqVMQ0txY441gP4krd678eMNEKnZgh-ZJV4XIGMDsEQlZJzbUfVcLOU Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 1893db2223fc4395a202c5124c94fdf8 Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:46:00.295263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1893db2223fc4395a202c5124c94fdf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1893db2223fc4395a202c5124c94fdf8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1893db2223fc4395a202c5124c94fdf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1893db2223fc4395a202c5124c94fdf8"}]}] Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 1893db2223fc4395a202c5124c94fdf8 Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesSnapshotsTestJSON-1426416081-project Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: d6cfe76f2e98474f802171dbf7a61244 Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1426416081-project Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'id': '8e5d075f-ea1b-4bca-a58f-65464226c80f'} Jul 18 16:46:00.296429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. (HTTP 404) (Request-ID: req-5a09801b-6434-48ab-922e-effa7f3572f4) Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:00.297101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:46:00.298158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:46:00.299042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a6a52b21-55e6-4381-8c8a-3cecafc8b6c6 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Returning 404 to user: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:46:00.300084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a6a52b21-55e6-4381-8c8a-3cecafc8b6c6 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f" status: 404 len: 109 microversion: 2.1 time: 0.081216 Jul 18 16:46:00.301963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 16/30] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:46:00 2022] GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:46:00.310273 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6d5191a0-a158-482c-9a57-06b662170c35 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6aecce160>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:00.332264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4160282b-9942-4790-adb3-9a4360add5a1 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1274 microversion: 2.1 time: 0.417498 Jul 18 16:46:00.332264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 15/31] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:45:59 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1274 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:00.357503 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-6d5191a0-a158-482c-9a57-06b662170c35 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] HTTP exception thrown: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6d5191a0-a158-482c-9a57-06b662170c35 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Request method failure captured: Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: DELETE /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f HTTP/1.1 Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y44sK-HP-xHRe9agCVjRSixtx2-IwS9QnMT8rhRk4W0_aodlQvalZY0LnnIXs14hLSMSOPFiriMuHgiSsCOotRvRHikphQLB7DooPfTi53xBUAfXpaaXUUKUqVMQ0txY441gP4krd678eMNEKnZgh-ZJV4XIGMDsEQlZJzbUfVcLOU Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 1893db2223fc4395a202c5124c94fdf8 Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:46:00.361048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1893db2223fc4395a202c5124c94fdf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1893db2223fc4395a202c5124c94fdf8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1893db2223fc4395a202c5124c94fdf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1893db2223fc4395a202c5124c94fdf8"}]}] Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 1893db2223fc4395a202c5124c94fdf8 Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesSnapshotsTestJSON-1426416081-project Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: d6cfe76f2e98474f802171dbf7a61244 Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1426416081-project Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'id': '8e5d075f-ea1b-4bca-a58f-65464226c80f'} Jul 18 16:46:00.362218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. (HTTP 404) (Request-ID: req-723f42b9-d9b4-4a85-a5d2-2db45fcddfce) Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:00.363014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 16:46:00.363984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 16:46:00.364914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6d5191a0-a158-482c-9a57-06b662170c35 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Returning 404 to user: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6d5191a0-a158-482c-9a57-06b662170c35 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f" status: 404 len: 109 microversion: 2.1 time: 0.056314 Jul 18 16:46:00.365810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 17/32] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 16:46:00 2022] DELETE /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:46:00.373409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bcb79d36-b3cd-4a32-a94f-e20aaae37f85 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Calling method '.version_select at 0x7fd6afeed4c0>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:00.458036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-bcb79d36-b3cd-4a32-a94f-e20aaae37f85 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] HTTP exception thrown: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bcb79d36-b3cd-4a32-a94f-e20aaae37f85 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Request method failure captured: Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f HTTP/1.1 Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y44sK-HP-xHRe9agCVjRSixtx2-IwS9QnMT8rhRk4W0_aodlQvalZY0LnnIXs14hLSMSOPFiriMuHgiSsCOotRvRHikphQLB7DooPfTi53xBUAfXpaaXUUKUqVMQ0txY441gP4krd678eMNEKnZgh-ZJV4XIGMDsEQlZJzbUfVcLOU Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 1893db2223fc4395a202c5124c94fdf8 Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 16:46:00.460363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1893db2223fc4395a202c5124c94fdf8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1893db2223fc4395a202c5124c94fdf8", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1893db2223fc4395a202c5124c94fdf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1893db2223fc4395a202c5124c94fdf8"}]}] Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 1893db2223fc4395a202c5124c94fdf8 Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1426416081 Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-VolumesSnapshotsTestJSON-1426416081-project Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: d6cfe76f2e98474f802171dbf7a61244 Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1426416081-project Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '8e5d075f-ea1b-4bca-a58f-65464226c80f'} Jul 18 16:46:00.462352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. (HTTP 404) (Request-ID: req-7025ebd4-cb37-40bd-9884-93b43893362e) Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:00.463006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:46:00.464599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:46:00.466480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bcb79d36-b3cd-4a32-a94f-e20aaae37f85 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] Returning 404 to user: Volume 8e5d075f-ea1b-4bca-a58f-65464226c80f could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bcb79d36-b3cd-4a32-a94f-e20aaae37f85 tempest-VolumesSnapshotsTestJSON-1426416081 tempest-VolumesSnapshotsTestJSON-1426416081-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f" status: 404 len: 109 microversion: 2.1 time: 0.094831 Jul 18 16:46:00.469030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 16/33] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:46:00 2022] GET /compute/v2.1/os-volumes/8e5d075f-ea1b-4bca-a58f-65464226c80f => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:46:01.349566 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4722af15-087c-4323-b17d-afec065ec35a tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:01.350394 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4722af15-087c-4323-b17d-afec065ec35a tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:01.365445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4722af15-087c-4323-b17d-afec065ec35a tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:01.369435 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4722af15-087c-4323-b17d-afec065ec35a tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:01.377924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4722af15-087c-4323-b17d-afec065ec35a tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:01.380625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4722af15-087c-4323-b17d-afec065ec35a tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:02.015423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4722af15-087c-4323-b17d-afec065ec35a tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:02.028094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4722af15-087c-4323-b17d-afec065ec35a tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1272 microversion: 2.1 time: 0.682912 Jul 18 16:46:02.029147 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 18/34] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:01 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1272 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:03.050917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-483fff18-5b37-4bb5-93ed-14ab3d608026 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:03.051690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-483fff18-5b37-4bb5-93ed-14ab3d608026 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:03.065905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-483fff18-5b37-4bb5-93ed-14ab3d608026 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:03.066595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-483fff18-5b37-4bb5-93ed-14ab3d608026 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:03.069886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-483fff18-5b37-4bb5-93ed-14ab3d608026 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:03.069886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-483fff18-5b37-4bb5-93ed-14ab3d608026 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:03.573376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-483fff18-5b37-4bb5-93ed-14ab3d608026 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:03.585128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-483fff18-5b37-4bb5-93ed-14ab3d608026 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.539369 Jul 18 16:46:03.586928 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 17/35] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:03 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:04.618826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-158a0c9a-ede2-47e4-9d45-bd88df215285 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:04.620201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-158a0c9a-ede2-47e4-9d45-bd88df215285 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:04.622923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=2 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:04.637558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-158a0c9a-ede2-47e4-9d45-bd88df215285 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:04.638984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-158a0c9a-ede2-47e4-9d45-bd88df215285 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:04.643076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-158a0c9a-ede2-47e4-9d45-bd88df215285 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:04.647187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-158a0c9a-ede2-47e4-9d45-bd88df215285 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:05.030456 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-158a0c9a-ede2-47e4-9d45-bd88df215285 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:05.041777 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-158a0c9a-ede2-47e4-9d45-bd88df215285 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.428732 Jul 18 16:46:05.055680 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 19/36] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:04 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:05.917715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:06.283117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-818028450", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:06.362930 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3bafaefe-0c14-4949-96a2-11a4be544cca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'create', calling method: .version_select at 0x7fd6aec9a820>, body: {"keypair": {"name": "tempest-keypair-1792594690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3xeDnY+1fmYhdXz3aTf3RkPo/5gVBfeIqQ6pOBsUXBktz3TYXSos2x+jzZ2skGdCvVuGVCmea8arMwAw1Qto4SgXqFJ4tI/kaDHBlW+xkDOuIZ6ZU0mU89hmecGwdbwg=="}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:06.428172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-3bafaefe-0c14-4949-96a2-11a4be544cca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Getting quotas for project 9e65f14a4bef42df904a5f15befe2e16. Resources: {'key_pairs'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:46:06.439422 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-3bafaefe-0c14-4949-96a2-11a4be544cca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Getting quotas for user c243a50903b244519ccd58f02cb798da and project 9e65f14a4bef42df904a5f15befe2e16. Resources: {'key_pairs'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:46:06.571567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3bafaefe-0c14-4949-96a2-11a4be544cca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.787172 Jul 18 16:46:06.571567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 20/37] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 16:46:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:06.580323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c7911306-88b3-4968-8bc5-9542f253bf84 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:06.580944 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c7911306-88b3-4968-8bc5-9542f253bf84 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:06.631807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c7911306-88b3-4968-8bc5-9542f253bf84 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:06.631807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c7911306-88b3-4968-8bc5-9542f253bf84 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:06.631807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c7911306-88b3-4968-8bc5-9542f253bf84 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:06.631807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c7911306-88b3-4968-8bc5-9542f253bf84 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:06.645675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] validate_networks() for [('1c726c5d-ab68-403e-98ff-f0508b7ceb81', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:46:07.885684 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c7911306-88b3-4968-8bc5-9542f253bf84 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:07.910704 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c7911306-88b3-4968-8bc5-9542f253bf84 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 1.334190 Jul 18 16:46:07.914524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 21/38] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:06 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:08.935953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-57978501-7f15-4c42-b1fc-22e653cf37ac tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:08.939280 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-57978501-7f15-4c42-b1fc-22e653cf37ac tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:08.955604 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-57978501-7f15-4c42-b1fc-22e653cf37ac tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:08.961299 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-57978501-7f15-4c42-b1fc-22e653cf37ac tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:08.966059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-57978501-7f15-4c42-b1fc-22e653cf37ac tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:08.972452 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-57978501-7f15-4c42-b1fc-22e653cf37ac tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:09.512841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:46:09.513355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:46:09.514746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:46:09.515176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:46:09.516147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:46:09.537981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:09.538571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:09.539790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:09.541057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:09.548795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-57978501-7f15-4c42-b1fc-22e653cf37ac tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:09.560461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-57978501-7f15-4c42-b1fc-22e653cf37ac tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.629001 Jul 18 16:46:09.564227 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 22/39] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:08 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:09.626077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Getting quotas for project 69c48eddc2334918970e61725bedafd1. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:46:09.635682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Getting quotas for user 642ba7eed36e4956834c06b771259a42 and project 69c48eddc2334918970e61725bedafd1. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:46:09.651031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:46:09.654126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:46:09.708129 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-edc961bf-50aa-4bf0-9493-1d49db8c51d9 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] Action: 'create', calling method: .version_select at 0x7fd6aec83d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1270271257", "metadata": {"Type": "work"}}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:09.893537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6f08d14f-1730-4e3d-8f32-0378234693ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.314576 Jul 18 16:46:09.906224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 18/40] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 16:46:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:46:10.005348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-dc7c2624-0c24-4e0b-a5c9-67556635f2b8 req-69c88c30-e94a-49be-ba00-7d5a7d5b044d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a3169eb-4570-46ca-84a2-8226e855da0f", "tag": "8ab03ff1-5bf8-4c2d-b3e6-cfe01ca0c3bd"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:10.069782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-dc7c2624-0c24-4e0b-a5c9-67556635f2b8 req-69c88c30-e94a-49be-ba00-7d5a7d5b044d service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:10.071967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-dc7c2624-0c24-4e0b-a5c9-67556635f2b8 req-69c88c30-e94a-49be-ba00-7d5a7d5b044d service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:10.144031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-dc7c2624-0c24-4e0b-a5c9-67556635f2b8 req-69c88c30-e94a-49be-ba00-7d5a7d5b044d service nova] Creating event network-changed:8ab03ff1-5bf8-4c2d-b3e6-cfe01ca0c3bd for instance 9a3169eb-4570-46ca-84a2-8226e855da0f on hv-cinder-84617 Jul 18 16:46:10.144582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-dc7c2624-0c24-4e0b-a5c9-67556635f2b8 req-69c88c30-e94a-49be-ba00-7d5a7d5b044d service nova] Acquired lock "compute-rpcapi-router" {{(pid=124944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 16:46:10.145728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-62820f4c-08f4-4298-aaa0-db25cf4c2e33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:10.146183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-62820f4c-08f4-4298-aaa0-db25cf4c2e33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:10.146976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-62820f4c-08f4-4298-aaa0-db25cf4c2e33 None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:10.147417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-62820f4c-08f4-4298-aaa0-db25cf4c2e33 None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:10.202772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.compute.rpcapi [None req-62820f4c-08f4-4298-aaa0-db25cf4c2e33 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 16:46:10.203678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-62820f4c-08f4-4298-aaa0-db25cf4c2e33 None None] Releasing lock "compute-rpcapi-router" {{(pid=124944) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 16:46:10.253036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-62820f4c-08f4-4298-aaa0-db25cf4c2e33 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354403 Jul 18 16:46:10.254794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 19/41] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:10.271163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-302abbcb-fbbb-43a0-8afe-2771fc77cf81 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:10.276177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-302abbcb-fbbb-43a0-8afe-2771fc77cf81 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:10.499780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-302abbcb-fbbb-43a0-8afe-2771fc77cf81 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:10.528922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-302abbcb-fbbb-43a0-8afe-2771fc77cf81 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1221 microversion: 2.1 time: 0.271958 Jul 18 16:46:10.552335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 20/42] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:10 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1221 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:10.590502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dff59ff7-24bc-41af-bc62-cfb73e0151e3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:10.595469 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-dff59ff7-24bc-41af-bc62-cfb73e0151e3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:10.614280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dff59ff7-24bc-41af-bc62-cfb73e0151e3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:10.630738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dff59ff7-24bc-41af-bc62-cfb73e0151e3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:10.636915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dff59ff7-24bc-41af-bc62-cfb73e0151e3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:10.648845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dff59ff7-24bc-41af-bc62-cfb73e0151e3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:11.090580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-dff59ff7-24bc-41af-bc62-cfb73e0151e3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:11.098636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dff59ff7-24bc-41af-bc62-cfb73e0151e3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.520296 Jul 18 16:46:11.108947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:10 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:11.110402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1650101022", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:11.268561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] validate_networks() for [('1c726c5d-ab68-403e-98ff-f0508b7ceb81', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:46:12.329423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-edc961bf-50aa-4bf0-9493-1d49db8c51d9 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.756333 Jul 18 16:46:12.331033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jul 18 16:46:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2761 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 16:46:12.338914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-361e72b5-0606-4d7e-ac94-1dc4d2142fbd tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:12.343023 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-361e72b5-0606-4d7e-ac94-1dc4d2142fbd tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:12.361132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-361e72b5-0606-4d7e-ac94-1dc4d2142fbd tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:12.364710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-361e72b5-0606-4d7e-ac94-1dc4d2142fbd tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:12.367869 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-361e72b5-0606-4d7e-ac94-1dc4d2142fbd tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:12.369000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-361e72b5-0606-4d7e-ac94-1dc4d2142fbd tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:12.773959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:46:12.774669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:46:12.774833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:46:12.775411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:46:12.776033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:46:12.805546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:12.806277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:12.807709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:12.808471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:12.853710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Getting quotas for project 69c48eddc2334918970e61725bedafd1. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:46:12.888179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Getting quotas for user 642ba7eed36e4956834c06b771259a42 and project 69c48eddc2334918970e61725bedafd1. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:46:12.903669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-361e72b5-0606-4d7e-ac94-1dc4d2142fbd tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:12.910991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:46:12.910991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:46:12.912740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-361e72b5-0606-4d7e-ac94-1dc4d2142fbd tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.580057 Jul 18 16:46:12.913541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 24/45] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:12 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:12.923245 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-59a04a63-1272-481d-8e05-e995375a5eb4 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] Calling method '.version_select at 0x7fd6aec55280>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:13.089393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-59a04a63-1272-481d-8e05-e995375a5eb4 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2" status: 200 len: 354 microversion: 2.1 time: 0.172464 Jul 18 16:46:13.089962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 25/46] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:46:12 2022] GET /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2 => generated 354 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:13.108678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-787dc386-e636-433c-9ae5-f1f49323b6f9 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] Calling method '.version_select at 0x7fd6aec65c10>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:13.182711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7ec44b63-ef92-4872-94cd-d40a7e9a6a3e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.080495 Jul 18 16:46:13.191216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 22/47] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 16:46:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:46:13.200473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3d83006f-478c-468d-9658-1e5945ab6656 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:13.202864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3d83006f-478c-468d-9658-1e5945ab6656 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:13.296566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3d83006f-478c-468d-9658-1e5945ab6656 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:13.307450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3d83006f-478c-468d-9658-1e5945ab6656 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1222 microversion: 2.1 time: 0.107523 Jul 18 16:46:13.308698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 23/48] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:13 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:13.357475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-787dc386-e636-433c-9ae5-f1f49323b6f9 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2" status: 200 len: 354 microversion: 2.1 time: 0.258636 Jul 18 16:46:13.359215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 26/49] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:46:13 2022] GET /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2 => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:13.379361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-578dde4d-7f63-4323-b506-917a92cdb468 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] Calling method '.version_select at 0x7fd6af4a2a60>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:13.933095 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-06cb2201-a1c5-44d1-bb8f-708427b3a489 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:13.933965 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-06cb2201-a1c5-44d1-bb8f-708427b3a489 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:13.943049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-06cb2201-a1c5-44d1-bb8f-708427b3a489 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:13.943572 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-06cb2201-a1c5-44d1-bb8f-708427b3a489 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:13.944699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-06cb2201-a1c5-44d1-bb8f-708427b3a489 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:13.945744 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-06cb2201-a1c5-44d1-bb8f-708427b3a489 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:14.011068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-578dde4d-7f63-4323-b506-917a92cdb468 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2" status: 202 len: 0 microversion: 2.1 time: 0.637629 Jul 18 16:46:14.012584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 24/50] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 16:46:13 2022] DELETE /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2 => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:46:14.021255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dc8ba067-8b52-49d9-a546-581dfca78850 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] Calling method '.version_select at 0x7fd6af47a430>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:14.323743 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-06cb2201-a1c5-44d1-bb8f-708427b3a489 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:14.340024 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-06cb2201-a1c5-44d1-bb8f-708427b3a489 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.405001 Jul 18 16:46:14.342331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 27/51] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:13 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:14.360303 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1438077641", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c914fcbf-a82f-409d-b8ef-3068a3677d9c"}], "security_groups": [{"name": "tempest-securitygroup--807891465"}], "key_name": "tempest-keypair-1792594690", "user_data": "}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:14.404724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dc8ba067-8b52-49d9-a546-581dfca78850 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2" status: 200 len: 353 microversion: 2.1 time: 0.387095 Jul 18 16:46:14.405362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 25/52] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:46:14 2022] GET /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2 => generated 353 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:46:14.411478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-640ebe1a-ac77-4a8d-8e35-ee9a2ee786bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:14.412178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-640ebe1a-ac77-4a8d-8e35-ee9a2ee786bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:14.526129 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-640ebe1a-ac77-4a8d-8e35-ee9a2ee786bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:14.536996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-640ebe1a-ac77-4a8d-8e35-ee9a2ee786bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1222 microversion: 2.1 time: 0.130198 Jul 18 16:46:14.538351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 26/53] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:14 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:14.628761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.network.neutron [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] validate_networks() for [('c914fcbf-a82f-409d-b8ef-3068a3677d9c', None, None, None, None, None)] {{(pid=124945) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:46:15.161828 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Flavor limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:46:15.162256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Image limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:46:15.171912 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Flavor pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:46:15.171912 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Image pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:46:15.171912 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:46:15.171912 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:15.173991 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=13 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:15.176214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.181633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.182833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.183509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.195325 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=45 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:15.215512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Getting quotas for project 9e65f14a4bef42df904a5f15befe2e16. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:46:15.220785 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Getting quotas for user c243a50903b244519ccd58f02cb798da and project 9e65f14a4bef42df904a5f15befe2e16. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:46:15.268806 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Going to run 1 instances... {{(pid=124945) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:46:15.271266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:46:15.363350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7e45ebef-dcc2-4355-a680-80df72fcb185 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:15.364213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7e45ebef-dcc2-4355-a680-80df72fcb185 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:15.369779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:15.375626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e45ebef-dcc2-4355-a680-80df72fcb185 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.376085 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e45ebef-dcc2-4355-a680-80df72fcb185 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.377044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e45ebef-dcc2-4355-a680-80df72fcb185 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.384225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e45ebef-dcc2-4355-a680-80df72fcb185 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.404130 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1aac4f52-2064-4bf5-bef9-a4211f3ead06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.060303 Jul 18 16:46:15.406707 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 28/54] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 16:46:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:46:15.425099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ea6a573e-5e3f-4ff2-994c-41cc0f2ae0ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:15.425781 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ea6a573e-5e3f-4ff2-994c-41cc0f2ae0ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:15.493409 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ea6a573e-5e3f-4ff2-994c-41cc0f2ae0ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:15.503829 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ea6a573e-5e3f-4ff2-994c-41cc0f2ae0ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1238 microversion: 2.1 time: 0.088221 Jul 18 16:46:15.505151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 29/55] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:15 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:15.517123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d9e05cc6-c48a-4269-b12e-2f455e25e043 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] Calling method '.version_select at 0x7fd6aec9a940>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:15.579592 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-d9e05cc6-c48a-4269-b12e-2f455e25e043 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] HTTP exception thrown: Volume 8218267d-cfce-4f74-87ce-47a8d3724cb2 could not be found. Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d9e05cc6-c48a-4269-b12e-2f455e25e043 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] Request method failure captured: Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: GET /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2 HTTP/1.1 Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y5Q_5ua2CcSDSdfHUDatYc-OPCRjS5J0yBK5YPAlXw6nggyDyhp0hdmMSSKly1Ys6xVOgK7-OIVwkkF8DGKOC2-8PPLpXo5-XopM2liDpMIFcarlWAR-tUNy_5cukjKfQJ-_idLQ7VuFnp806sJD91FLuIAIhNVxIGAL1E3V8zXEQo Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 3b6d4eddd46d470baf8708ff620bc04f Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesGetTestJSON-1164303565 Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:46:15.582083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b6d4eddd46d470baf8708ff620bc04f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3b6d4eddd46d470baf8708ff620bc04f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3b6d4eddd46d470baf8708ff620bc04f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3b6d4eddd46d470baf8708ff620bc04f"}]}] Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesGetTestJSON-1164303565 Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 3b6d4eddd46d470baf8708ff620bc04f Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesGetTestJSON-1164303565 Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesGetTestJSON-1164303565-project Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: ef589cb8f371419381b52f6307521255 Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesGetTestJSON-1164303565-project Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Volume 8218267d-cfce-4f74-87ce-47a8d3724cb2 could not be found. Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'id': '8218267d-cfce-4f74-87ce-47a8d3724cb2'} Jul 18 16:46:15.583732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8218267d-cfce-4f74-87ce-47a8d3724cb2 could not be found. (HTTP 404) (Request-ID: req-a1253b89-1863-4958-9360-c208000aad98) Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:15.584616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 16:46:15.586823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8218267d-cfce-4f74-87ce-47a8d3724cb2 could not be found. Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 16:46:15.588692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8218267d-cfce-4f74-87ce-47a8d3724cb2 could not be found. Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8218267d-cfce-4f74-87ce-47a8d3724cb2 could not be found. Jul 18 16:46:15.589941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:46:15.592533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d9e05cc6-c48a-4269-b12e-2f455e25e043 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] Returning 404 to user: Volume 8218267d-cfce-4f74-87ce-47a8d3724cb2 could not be found. {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:46:15.593652 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d9e05cc6-c48a-4269-b12e-2f455e25e043 tempest-VolumesGetTestJSON-1164303565 tempest-VolumesGetTestJSON-1164303565-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2" status: 404 len: 109 microversion: 2.1 time: 0.086865 Jul 18 16:46:15.594368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 30/56] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 16:46:15 2022] GET /compute/v2.1/os-volumes/8218267d-cfce-4f74-87ce-47a8d3724cb2 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:46:15.600735 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-73c10bfb-65cb-4352-88c0-ead974f0844e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:15.608365 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-73c10bfb-65cb-4352-88c0-ead974f0844e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:15.625651 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c10bfb-65cb-4352-88c0-ead974f0844e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.626439 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c10bfb-65cb-4352-88c0-ead974f0844e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.627463 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c10bfb-65cb-4352-88c0-ead974f0844e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:15.628312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c10bfb-65cb-4352-88c0-ead974f0844e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:15.724013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7e45ebef-dcc2-4355-a680-80df72fcb185 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:15.743562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7e45ebef-dcc2-4355-a680-80df72fcb185 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.381313 Jul 18 16:46:15.743562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 27/57] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:15 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:15.776493 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-73c10bfb-65cb-4352-88c0-ead974f0844e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:15.790346 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-73c10bfb-65cb-4352-88c0-ead974f0844e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1226 microversion: 2.1 time: 0.194525 Jul 18 16:46:15.790963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 31/58] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:15 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1226 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:16.528834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-160a22bb-f045-4582-93d0-f059cb00bd8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:16.529450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-160a22bb-f045-4582-93d0-f059cb00bd8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:16.597905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-160a22bb-f045-4582-93d0-f059cb00bd8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:16.610318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-160a22bb-f045-4582-93d0-f059cb00bd8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1238 microversion: 2.1 time: 0.085280 Jul 18 16:46:16.611157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 28/59] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:16 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:16.759240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cd9eb7b0-01ff-46be-82a6-bd63e8ee202e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:16.759974 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cd9eb7b0-01ff-46be-82a6-bd63e8ee202e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:16.768137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cd9eb7b0-01ff-46be-82a6-bd63e8ee202e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:16.768684 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cd9eb7b0-01ff-46be-82a6-bd63e8ee202e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:16.769458 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cd9eb7b0-01ff-46be-82a6-bd63e8ee202e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:16.769885 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cd9eb7b0-01ff-46be-82a6-bd63e8ee202e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:16.814223 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9380d8f4-c53f-4e44-9909-0b57fa149d51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:16.816344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9380d8f4-c53f-4e44-9909-0b57fa149d51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:16.826291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9380d8f4-c53f-4e44-9909-0b57fa149d51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:16.827846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9380d8f4-c53f-4e44-9909-0b57fa149d51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:16.828854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9380d8f4-c53f-4e44-9909-0b57fa149d51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:16.829815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9380d8f4-c53f-4e44-9909-0b57fa149d51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:16.935108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9380d8f4-c53f-4e44-9909-0b57fa149d51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:16.955961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9380d8f4-c53f-4e44-9909-0b57fa149d51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1226 microversion: 2.1 time: 0.148997 Jul 18 16:46:16.966337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 29/60] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:16 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1226 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:17.170778 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cd9eb7b0-01ff-46be-82a6-bd63e8ee202e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:17.180818 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cd9eb7b0-01ff-46be-82a6-bd63e8ee202e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.426328 Jul 18 16:46:17.181879 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 32/61] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:16 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:17.628532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e5f5f511-0c22-47ab-9d93-1af41826a769 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:17.629292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e5f5f511-0c22-47ab-9d93-1af41826a769 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:17.635695 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e5f5f511-0c22-47ab-9d93-1af41826a769 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:17.636372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e5f5f511-0c22-47ab-9d93-1af41826a769 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:17.637376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e5f5f511-0c22-47ab-9d93-1af41826a769 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:17.638013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e5f5f511-0c22-47ab-9d93-1af41826a769 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:17.719586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e5f5f511-0c22-47ab-9d93-1af41826a769 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:17.730379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e5f5f511-0c22-47ab-9d93-1af41826a769 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1242 microversion: 2.1 time: 0.105486 Jul 18 16:46:17.730975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 30/62] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:17 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:17.974408 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7c193909-f606-433a-8c0d-764a226197de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:17.974978 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7c193909-f606-433a-8c0d-764a226197de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:17.981574 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7c193909-f606-433a-8c0d-764a226197de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:17.982016 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7c193909-f606-433a-8c0d-764a226197de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:17.983035 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7c193909-f606-433a-8c0d-764a226197de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:17.983475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7c193909-f606-433a-8c0d-764a226197de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:18.056823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7c193909-f606-433a-8c0d-764a226197de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:18.064316 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7c193909-f606-433a-8c0d-764a226197de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1218 microversion: 2.1 time: 0.094185 Jul 18 16:46:18.064879 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 33/63] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:17 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:18.207859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-33ec4036-e410-41e5-8ccc-7fa1d7a0edc2 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:18.210145 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-33ec4036-e410-41e5-8ccc-7fa1d7a0edc2 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:18.236844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33ec4036-e410-41e5-8ccc-7fa1d7a0edc2 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:18.237301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33ec4036-e410-41e5-8ccc-7fa1d7a0edc2 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:18.238086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33ec4036-e410-41e5-8ccc-7fa1d7a0edc2 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:18.241980 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33ec4036-e410-41e5-8ccc-7fa1d7a0edc2 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:18.464268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-33ec4036-e410-41e5-8ccc-7fa1d7a0edc2 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:18.476038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-33ec4036-e410-41e5-8ccc-7fa1d7a0edc2 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.277149 Jul 18 16:46:18.484589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 31/64] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:18 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:18.748329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4cf199be-8b18-4625-b7fe-d10f70aa8ef5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:18.759713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4cf199be-8b18-4625-b7fe-d10f70aa8ef5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:18.759713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4cf199be-8b18-4625-b7fe-d10f70aa8ef5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:18.759713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4cf199be-8b18-4625-b7fe-d10f70aa8ef5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:18.759713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4cf199be-8b18-4625-b7fe-d10f70aa8ef5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:18.760574 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4cf199be-8b18-4625-b7fe-d10f70aa8ef5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:18.877888 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4cf199be-8b18-4625-b7fe-d10f70aa8ef5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:18.890074 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4cf199be-8b18-4625-b7fe-d10f70aa8ef5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1242 microversion: 2.1 time: 0.145702 Jul 18 16:46:18.893486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 34/65] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:18 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1242 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:19.083850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-56025afd-310d-4225-971e-a53500180176 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:19.095936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-56025afd-310d-4225-971e-a53500180176 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:19.108464 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-56025afd-310d-4225-971e-a53500180176 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.108850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-56025afd-310d-4225-971e-a53500180176 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:19.109747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-56025afd-310d-4225-971e-a53500180176 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.110203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-56025afd-310d-4225-971e-a53500180176 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:19.202231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-56025afd-310d-4225-971e-a53500180176 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:19.210328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-56025afd-310d-4225-971e-a53500180176 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1274 microversion: 2.1 time: 0.130901 Jul 18 16:46:19.211899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 32/66] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:19 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:19.494193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-40766680-6478-464f-a95c-5af046cbd77e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:19.498331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-40766680-6478-464f-a95c-5af046cbd77e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:19.501415 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-40766680-6478-464f-a95c-5af046cbd77e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.501858 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-40766680-6478-464f-a95c-5af046cbd77e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:19.502631 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-40766680-6478-464f-a95c-5af046cbd77e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.503065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-40766680-6478-464f-a95c-5af046cbd77e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:19.754903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-40766680-6478-464f-a95c-5af046cbd77e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:19.769278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-40766680-6478-464f-a95c-5af046cbd77e tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.278988 Jul 18 16:46:19.775659 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 35/67] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:19 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:19.910514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e7b3defe-9f05-4e4d-a04a-fd7d960bac49 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:19.911434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e7b3defe-9f05-4e4d-a04a-fd7d960bac49 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:19.918220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e7b3defe-9f05-4e4d-a04a-fd7d960bac49 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.918925 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e7b3defe-9f05-4e4d-a04a-fd7d960bac49 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:19.919769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e7b3defe-9f05-4e4d-a04a-fd7d960bac49 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:19.920528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e7b3defe-9f05-4e4d-a04a-fd7d960bac49 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:20.245752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e7b3defe-9f05-4e4d-a04a-fd7d960bac49 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:20.246509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-062521f6-11c0-435e-b927-ece366780d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:20.246509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-062521f6-11c0-435e-b927-ece366780d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:20.246650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e7b3defe-9f05-4e4d-a04a-fd7d960bac49 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1290 microversion: 2.1 time: 0.325260 Jul 18 16:46:20.246723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-062521f6-11c0-435e-b927-ece366780d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:20.246723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-062521f6-11c0-435e-b927-ece366780d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:20.246723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-062521f6-11c0-435e-b927-ece366780d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:20.246723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-062521f6-11c0-435e-b927-ece366780d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:20.247642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 33/68] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:19 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1290 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:20.436128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-062521f6-11c0-435e-b927-ece366780d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:20.451395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-062521f6-11c0-435e-b927-ece366780d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1282 microversion: 2.1 time: 0.222126 Jul 18 16:46:20.455262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 36/69] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:20 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1282 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:20.787281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-86679add-0f94-4e19-91ae-516d8e2d4fc3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:20.787609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-86679add-0f94-4e19-91ae-516d8e2d4fc3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:20.811895 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-86679add-0f94-4e19-91ae-516d8e2d4fc3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:20.813106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-86679add-0f94-4e19-91ae-516d8e2d4fc3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:20.822283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-86679add-0f94-4e19-91ae-516d8e2d4fc3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:20.824776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-86679add-0f94-4e19-91ae-516d8e2d4fc3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:21.257359 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7f2bb5fe-3f4d-4cda-9331-c3b0d8c0f9ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:21.257359 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7f2bb5fe-3f4d-4cda-9331-c3b0d8c0f9ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:21.267811 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f2bb5fe-3f4d-4cda-9331-c3b0d8c0f9ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:21.268987 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f2bb5fe-3f4d-4cda-9331-c3b0d8c0f9ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:21.270469 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f2bb5fe-3f4d-4cda-9331-c3b0d8c0f9ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:21.271140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f2bb5fe-3f4d-4cda-9331-c3b0d8c0f9ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:21.412161 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7f2bb5fe-3f4d-4cda-9331-c3b0d8c0f9ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:21.419961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7f2bb5fe-3f4d-4cda-9331-c3b0d8c0f9ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1296 microversion: 2.1 time: 0.169069 Jul 18 16:46:21.420740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 37/70] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1296 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:21.440475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-86679add-0f94-4e19-91ae-516d8e2d4fc3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:21.453886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-86679add-0f94-4e19-91ae-516d8e2d4fc3 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.671408 Jul 18 16:46:21.456190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 34/71] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:20 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:21.479324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f55404b9-a013-4c6a-8419-744f6059ef9b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:21.479973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f55404b9-a013-4c6a-8419-744f6059ef9b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:21.497124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f55404b9-a013-4c6a-8419-744f6059ef9b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:21.497610 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f55404b9-a013-4c6a-8419-744f6059ef9b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:21.498442 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f55404b9-a013-4c6a-8419-744f6059ef9b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:21.503458 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f55404b9-a013-4c6a-8419-744f6059ef9b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:21.686201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f55404b9-a013-4c6a-8419-744f6059ef9b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:21.704680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-6c9eeab7-bd57-450d-a186-3a584a6cf6a7 req-8b9d0590-09e8-42a4-a934-398022549b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec9999e7-353f-4229-b587-c22a59c07d8b", "tag": "85d1bdf4-c79d-49ad-895c-d1bd9ffbe943"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:21.713552 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f55404b9-a013-4c6a-8419-744f6059ef9b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1280 microversion: 2.1 time: 0.241396 Jul 18 16:46:21.714144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 38/72] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:21 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:21.719424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-6c9eeab7-bd57-450d-a186-3a584a6cf6a7 req-8b9d0590-09e8-42a4-a934-398022549b31 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:21.720007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-6c9eeab7-bd57-450d-a186-3a584a6cf6a7 req-8b9d0590-09e8-42a4-a934-398022549b31 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:21.755396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-6c9eeab7-bd57-450d-a186-3a584a6cf6a7 req-8b9d0590-09e8-42a4-a934-398022549b31 service nova] Creating event network-changed:85d1bdf4-c79d-49ad-895c-d1bd9ffbe943 for instance ec9999e7-353f-4229-b587-c22a59c07d8b on hv-cinder-84617 Jul 18 16:46:21.757673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-6c9eeab7-bd57-450d-a186-3a584a6cf6a7 req-8b9d0590-09e8-42a4-a934-398022549b31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056637 Jul 18 16:46:21.761422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 35/73] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:46:22.438205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-236507f6-e77f-49d3-a6e6-837639eba85f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:22.440221 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-236507f6-e77f-49d3-a6e6-837639eba85f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:22.451385 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-236507f6-e77f-49d3-a6e6-837639eba85f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.452204 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-236507f6-e77f-49d3-a6e6-837639eba85f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.453146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-236507f6-e77f-49d3-a6e6-837639eba85f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.453788 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-236507f6-e77f-49d3-a6e6-837639eba85f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.474074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f4cf817b-c024-48a5-a1d9-4072d751a030 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:22.474779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f4cf817b-c024-48a5-a1d9-4072d751a030 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:22.487245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4cf817b-c024-48a5-a1d9-4072d751a030 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.494036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4cf817b-c024-48a5-a1d9-4072d751a030 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.495453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4cf817b-c024-48a5-a1d9-4072d751a030 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:22.496915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4cf817b-c024-48a5-a1d9-4072d751a030 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:22.818118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=6 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:23.017260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f4cf817b-c024-48a5-a1d9-4072d751a030 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:23.043453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f4cf817b-c024-48a5-a1d9-4072d751a030 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.573682 Jul 18 16:46:23.058913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 36/74] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:22 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:23.080840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f85649a8-26d2-4c6c-a6b3-7843f90841e7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:23.082274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f85649a8-26d2-4c6c-a6b3-7843f90841e7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:23.112913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f85649a8-26d2-4c6c-a6b3-7843f90841e7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.113785 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f85649a8-26d2-4c6c-a6b3-7843f90841e7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.115230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f85649a8-26d2-4c6c-a6b3-7843f90841e7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.116065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f85649a8-26d2-4c6c-a6b3-7843f90841e7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.433958 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-236507f6-e77f-49d3-a6e6-837639eba85f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:23.467106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-236507f6-e77f-49d3-a6e6-837639eba85f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 1.032783 Jul 18 16:46:23.473797 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 39/75] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:23.577694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f85649a8-26d2-4c6c-a6b3-7843f90841e7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:23.595955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f85649a8-26d2-4c6c-a6b3-7843f90841e7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.532531 Jul 18 16:46:23.596585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 37/76] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:23 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:23.694424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-d1163d57-d2d5-4d06-953a-f51c082824e2 req-eb8f1f25-53b7-4ab6-96dd-2e20b12da054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3169eb-4570-46ca-84a2-8226e855da0f", "name": "network-vif-plugged", "status": "completed", "tag": "8ab03ff1-5bf8-4c2d-b3e6-cfe01ca0c3bd"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:23.714943 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-d1163d57-d2d5-4d06-953a-f51c082824e2 req-eb8f1f25-53b7-4ab6-96dd-2e20b12da054 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.715401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-d1163d57-d2d5-4d06-953a-f51c082824e2 req-eb8f1f25-53b7-4ab6-96dd-2e20b12da054 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.755909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-d1163d57-d2d5-4d06-953a-f51c082824e2 req-eb8f1f25-53b7-4ab6-96dd-2e20b12da054 service nova] Creating event network-vif-plugged:8ab03ff1-5bf8-4c2d-b3e6-cfe01ca0c3bd for instance 9a3169eb-4570-46ca-84a2-8226e855da0f on hv-cinder-84617 Jul 18 16:46:23.756611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-d1163d57-d2d5-4d06-953a-f51c082824e2 req-eb8f1f25-53b7-4ab6-96dd-2e20b12da054 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 16:46:23.758266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0ae96e4c-d782-43fb-95e2-846be91256ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.758817 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0ae96e4c-d782-43fb-95e2-846be91256ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.760731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0ae96e4c-d782-43fb-95e2-846be91256ca None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:23.761764 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0ae96e4c-d782-43fb-95e2-846be91256ca None None] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:23.772165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.compute.rpcapi [None req-0ae96e4c-d782-43fb-95e2-846be91256ca None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 16:46:23.773075 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0ae96e4c-d782-43fb-95e2-846be91256ca None None] Releasing lock "compute-rpcapi-router" {{(pid=124945) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 16:46:23.802998 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0ae96e4c-d782-43fb-95e2-846be91256ca None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326600 Jul 18 16:46:23.803641 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 40/77] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:24.075648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dddc5ae9-6f29-40cb-a427-1b6ca904509f tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:24.077121 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-dddc5ae9-6f29-40cb-a427-1b6ca904509f tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:24.091212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dddc5ae9-6f29-40cb-a427-1b6ca904509f tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:24.093501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dddc5ae9-6f29-40cb-a427-1b6ca904509f tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:24.095545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dddc5ae9-6f29-40cb-a427-1b6ca904509f tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:24.097848 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dddc5ae9-6f29-40cb-a427-1b6ca904509f tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:24.496627 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-54fe6070-eaa4-47da-be21-8bbe19ef641e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:24.504623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-54fe6070-eaa4-47da-be21-8bbe19ef641e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:24.530319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54fe6070-eaa4-47da-be21-8bbe19ef641e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:24.534903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54fe6070-eaa4-47da-be21-8bbe19ef641e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:24.536053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54fe6070-eaa4-47da-be21-8bbe19ef641e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:24.537188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-dddc5ae9-6f29-40cb-a427-1b6ca904509f tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:24.541837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54fe6070-eaa4-47da-be21-8bbe19ef641e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:24.546653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dddc5ae9-6f29-40cb-a427-1b6ca904509f tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.477086 Jul 18 16:46:24.561529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 38/78] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:24 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:24.613539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-eb7daf09-78b1-495f-9ead-e06bb6b332d4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:24.614839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-eb7daf09-78b1-495f-9ead-e06bb6b332d4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:24.628156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eb7daf09-78b1-495f-9ead-e06bb6b332d4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:24.630234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eb7daf09-78b1-495f-9ead-e06bb6b332d4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:24.631718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eb7daf09-78b1-495f-9ead-e06bb6b332d4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:24.634794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eb7daf09-78b1-495f-9ead-e06bb6b332d4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:24.937940 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-54fe6070-eaa4-47da-be21-8bbe19ef641e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:24.949036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-54fe6070-eaa4-47da-be21-8bbe19ef641e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.459277 Jul 18 16:46:24.950041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 41/79] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:25.013985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-eb7daf09-78b1-495f-9ead-e06bb6b332d4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:25.022692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-eb7daf09-78b1-495f-9ead-e06bb6b332d4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.412810 Jul 18 16:46:25.025477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 39/80] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:24 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:25.177607 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-8a0fedab-7f81-47da-8acc-e206798efa76 req-7509d453-358c-4ac9-a6c3-4d158301cf8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dee0085-26fb-4535-8630-6f96f19445f5", "tag": "49c5aa19-e689-4128-befe-ef9cd042860a"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:25.216932 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-8a0fedab-7f81-47da-8acc-e206798efa76 req-7509d453-358c-4ac9-a6c3-4d158301cf8a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:25.218775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-8a0fedab-7f81-47da-8acc-e206798efa76 req-7509d453-358c-4ac9-a6c3-4d158301cf8a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:25.255735 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-8a0fedab-7f81-47da-8acc-e206798efa76 req-7509d453-358c-4ac9-a6c3-4d158301cf8a service nova] Creating event network-changed:49c5aa19-e689-4128-befe-ef9cd042860a for instance 7dee0085-26fb-4535-8630-6f96f19445f5 on hv-cinder-84617 Jul 18 16:46:25.276957 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-8a0fedab-7f81-47da-8acc-e206798efa76 req-7509d453-358c-4ac9-a6c3-4d158301cf8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099868 Jul 18 16:46:25.279367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 42/81] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:25.579593 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-69028979-5ef8-4503-91c8-0ace93963d97 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:25.580203 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-69028979-5ef8-4503-91c8-0ace93963d97 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:25.592615 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-69028979-5ef8-4503-91c8-0ace93963d97 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:25.593066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-69028979-5ef8-4503-91c8-0ace93963d97 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:25.593888 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-69028979-5ef8-4503-91c8-0ace93963d97 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:25.594323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-69028979-5ef8-4503-91c8-0ace93963d97 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:25.762261 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-69028979-5ef8-4503-91c8-0ace93963d97 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:25.770286 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-69028979-5ef8-4503-91c8-0ace93963d97 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.196152 Jul 18 16:46:25.771112 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 43/82] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:25 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:25.967135 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-72636ce3-dd2e-4297-9998-9f41d8d4d02a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:25.967786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-72636ce3-dd2e-4297-9998-9f41d8d4d02a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:25.973741 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-72636ce3-dd2e-4297-9998-9f41d8d4d02a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:25.974190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-72636ce3-dd2e-4297-9998-9f41d8d4d02a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:25.975029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-72636ce3-dd2e-4297-9998-9f41d8d4d02a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:25.975472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-72636ce3-dd2e-4297-9998-9f41d8d4d02a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:26.265270 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-72636ce3-dd2e-4297-9998-9f41d8d4d02a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:26.276330 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-72636ce3-dd2e-4297-9998-9f41d8d4d02a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.313145 Jul 18 16:46:26.277033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 44/83] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:26.281553 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-77ea6847-8163-4032-a055-5ec1cb428905 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:26.282389 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-77ea6847-8163-4032-a055-5ec1cb428905 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:26.295526 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-77ea6847-8163-4032-a055-5ec1cb428905 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:26.296318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-77ea6847-8163-4032-a055-5ec1cb428905 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:26.297109 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-77ea6847-8163-4032-a055-5ec1cb428905 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:26.297554 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-77ea6847-8163-4032-a055-5ec1cb428905 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:26.468020 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-77ea6847-8163-4032-a055-5ec1cb428905 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:26.475920 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-77ea6847-8163-4032-a055-5ec1cb428905 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.197991 Jul 18 16:46:26.476498 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 45/84] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:26 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:26.610280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=20 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:26.788617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-36540d87-638b-4d6b-830b-1dd8b814aa1c tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:26.789202 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-36540d87-638b-4d6b-830b-1dd8b814aa1c tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:26.791527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=7 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:26.796571 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-36540d87-638b-4d6b-830b-1dd8b814aa1c tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:26.797007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-36540d87-638b-4d6b-830b-1dd8b814aa1c tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:26.797775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-36540d87-638b-4d6b-830b-1dd8b814aa1c tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:26.798215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-36540d87-638b-4d6b-830b-1dd8b814aa1c tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:26.969050 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-36540d87-638b-4d6b-830b-1dd8b814aa1c tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:26.981061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-36540d87-638b-4d6b-830b-1dd8b814aa1c tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1314 microversion: 2.1 time: 0.196543 Jul 18 16:46:26.981837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 46/85] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:26 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:27.035658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-d7f5c1a2-8228-480f-b508-538e490656dc req-9b1b9259-f0c4-4183-96b0-49b31e4f1f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed4624c-89d5-468c-bff4-3576ada7c0a9", "tag": "cc4ff60b-9404-43c6-98e9-71dd77fc67c6"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:27.045302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d7f5c1a2-8228-480f-b508-538e490656dc req-9b1b9259-f0c4-4183-96b0-49b31e4f1f2e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:27.045750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d7f5c1a2-8228-480f-b508-538e490656dc req-9b1b9259-f0c4-4183-96b0-49b31e4f1f2e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:27.050350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=95 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:27.058883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-d7f5c1a2-8228-480f-b508-538e490656dc req-9b1b9259-f0c4-4183-96b0-49b31e4f1f2e service nova] Creating event network-changed:cc4ff60b-9404-43c6-98e9-71dd77fc67c6 for instance 1ed4624c-89d5-468c-bff4-3576ada7c0a9 on hv-cinder-84617 Jul 18 16:46:27.065506 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-d7f5c1a2-8228-480f-b508-538e490656dc req-9b1b9259-f0c4-4183-96b0-49b31e4f1f2e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.736723 Jul 18 16:46:27.066941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 40/86] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:27.299968 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6218960b-fcbb-46cc-8c9a-048fbe843eb9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:27.300569 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6218960b-fcbb-46cc-8c9a-048fbe843eb9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:27.308123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6218960b-fcbb-46cc-8c9a-048fbe843eb9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:27.308571 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6218960b-fcbb-46cc-8c9a-048fbe843eb9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:27.311251 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6218960b-fcbb-46cc-8c9a-048fbe843eb9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:27.311251 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6218960b-fcbb-46cc-8c9a-048fbe843eb9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:27.446696 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6218960b-fcbb-46cc-8c9a-048fbe843eb9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:27.454398 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6218960b-fcbb-46cc-8c9a-048fbe843eb9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.158177 Jul 18 16:46:27.454962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 47/87] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:27.494591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1093f104-4334-4fa3-b9ce-ee58f43a1a75 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:27.495328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1093f104-4334-4fa3-b9ce-ee58f43a1a75 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:27.502010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1093f104-4334-4fa3-b9ce-ee58f43a1a75 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:27.506286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1093f104-4334-4fa3-b9ce-ee58f43a1a75 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:27.506286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1093f104-4334-4fa3-b9ce-ee58f43a1a75 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:27.506286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1093f104-4334-4fa3-b9ce-ee58f43a1a75 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:27.667962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1093f104-4334-4fa3-b9ce-ee58f43a1a75 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:27.677310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1093f104-4334-4fa3-b9ce-ee58f43a1a75 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.187241 Jul 18 16:46:27.678574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 41/88] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:27 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:28.005382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e5035c35-a642-4db4-8b87-e17950ef18cc tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:28.007019 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e5035c35-a642-4db4-8b87-e17950ef18cc tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:28.018220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5035c35-a642-4db4-8b87-e17950ef18cc tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:28.018920 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5035c35-a642-4db4-8b87-e17950ef18cc tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:28.020120 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5035c35-a642-4db4-8b87-e17950ef18cc tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:28.020850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5035c35-a642-4db4-8b87-e17950ef18cc tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:28.055299 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:28.237464 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e5035c35-a642-4db4-8b87-e17950ef18cc tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:28.248444 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e5035c35-a642-4db4-8b87-e17950ef18cc tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1502 microversion: 2.1 time: 0.247980 Jul 18 16:46:28.249075 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 48/89] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:27 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:28.321872 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-dd9931f4-9c66-42fd-92ae-5b685a04b5c2 req-47221bdc-e989-4885-b75d-fd199c829633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9999e7-353f-4229-b587-c22a59c07d8b", "name": "network-vif-plugged", "status": "completed", "tag": "85d1bdf4-c79d-49ad-895c-d1bd9ffbe943"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:28.330453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-dd9931f4-9c66-42fd-92ae-5b685a04b5c2 req-47221bdc-e989-4885-b75d-fd199c829633 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:28.331517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-dd9931f4-9c66-42fd-92ae-5b685a04b5c2 req-47221bdc-e989-4885-b75d-fd199c829633 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:28.344982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-dd9931f4-9c66-42fd-92ae-5b685a04b5c2 req-47221bdc-e989-4885-b75d-fd199c829633 service nova] Creating event network-vif-plugged:85d1bdf4-c79d-49ad-895c-d1bd9ffbe943 for instance ec9999e7-353f-4229-b587-c22a59c07d8b on hv-cinder-84617 Jul 18 16:46:28.350084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-dd9931f4-9c66-42fd-92ae-5b685a04b5c2 req-47221bdc-e989-4885-b75d-fd199c829633 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 Jul 18 16:46:28.350784 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 42/90] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:46:28.471288 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-604eba64-f522-4e5e-8add-2e0bf344c3ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:28.472092 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-604eba64-f522-4e5e-8add-2e0bf344c3ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:28.479921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-604eba64-f522-4e5e-8add-2e0bf344c3ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:28.480754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-604eba64-f522-4e5e-8add-2e0bf344c3ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:28.481596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-604eba64-f522-4e5e-8add-2e0bf344c3ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:28.482039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-604eba64-f522-4e5e-8add-2e0bf344c3ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:28.625326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-604eba64-f522-4e5e-8add-2e0bf344c3ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:28.632761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-604eba64-f522-4e5e-8add-2e0bf344c3ef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.165358 Jul 18 16:46:28.634032 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 49/91] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:28 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:28.698066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-da7c88e6-ae26-4425-af12-01a9ace1f93d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:28.698810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-da7c88e6-ae26-4425-af12-01a9ace1f93d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:28.706457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da7c88e6-ae26-4425-af12-01a9ace1f93d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:28.706974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da7c88e6-ae26-4425-af12-01a9ace1f93d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:28.708096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da7c88e6-ae26-4425-af12-01a9ace1f93d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:28.708477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da7c88e6-ae26-4425-af12-01a9ace1f93d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:29.029460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-da7c88e6-ae26-4425-af12-01a9ace1f93d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:29.037280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-da7c88e6-ae26-4425-af12-01a9ace1f93d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.344401 Jul 18 16:46:29.037871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 43/92] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:28 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:29.650826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6ccc4910-d8c2-4da1-a59f-d50d52061e2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:29.651524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6ccc4910-d8c2-4da1-a59f-d50d52061e2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:29.669847 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ccc4910-d8c2-4da1-a59f-d50d52061e2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:29.670668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ccc4910-d8c2-4da1-a59f-d50d52061e2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:29.671814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ccc4910-d8c2-4da1-a59f-d50d52061e2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:29.672238 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ccc4910-d8c2-4da1-a59f-d50d52061e2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:29.895314 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6ccc4910-d8c2-4da1-a59f-d50d52061e2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:29.903737 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6ccc4910-d8c2-4da1-a59f-d50d52061e2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.257424 Jul 18 16:46:29.904310 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 50/93] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:29 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:30.054857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f2eb33f8-a229-4f01-a40a-66e3a8d28293 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:30.055450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f2eb33f8-a229-4f01-a40a-66e3a8d28293 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:30.062862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2eb33f8-a229-4f01-a40a-66e3a8d28293 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:30.063307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2eb33f8-a229-4f01-a40a-66e3a8d28293 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:30.064333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2eb33f8-a229-4f01-a40a-66e3a8d28293 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:30.064671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2eb33f8-a229-4f01-a40a-66e3a8d28293 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:30.205070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f2eb33f8-a229-4f01-a40a-66e3a8d28293 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:30.213854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f2eb33f8-a229-4f01-a40a-66e3a8d28293 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.163229 Jul 18 16:46:30.224112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 44/94] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:30 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:30.922042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9433a75a-f8c7-4d66-b3d5-a259a491ce9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:30.923184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9433a75a-f8c7-4d66-b3d5-a259a491ce9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:30.931123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9433a75a-f8c7-4d66-b3d5-a259a491ce9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:30.931548 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9433a75a-f8c7-4d66-b3d5-a259a491ce9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:30.932252 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9433a75a-f8c7-4d66-b3d5-a259a491ce9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:30.932861 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9433a75a-f8c7-4d66-b3d5-a259a491ce9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:31.145182 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9433a75a-f8c7-4d66-b3d5-a259a491ce9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:31.154649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9433a75a-f8c7-4d66-b3d5-a259a491ce9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.237622 Jul 18 16:46:31.155720 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 51/95] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:31.230703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-888fc018-37dd-495f-b6e6-cfc858c545b1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:31.231911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-888fc018-37dd-495f-b6e6-cfc858c545b1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:31.238287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-888fc018-37dd-495f-b6e6-cfc858c545b1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:31.245843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-888fc018-37dd-495f-b6e6-cfc858c545b1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:31.245843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-888fc018-37dd-495f-b6e6-cfc858c545b1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:31.245843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-888fc018-37dd-495f-b6e6-cfc858c545b1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:31.565115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-888fc018-37dd-495f-b6e6-cfc858c545b1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:31.573822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-888fc018-37dd-495f-b6e6-cfc858c545b1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.347412 Jul 18 16:46:31.574385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 45/96] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:31 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:32.172241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7cb177d6-15cb-4570-aff0-de38012a120a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:32.173243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7cb177d6-15cb-4570-aff0-de38012a120a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:32.184595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7cb177d6-15cb-4570-aff0-de38012a120a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.186491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7cb177d6-15cb-4570-aff0-de38012a120a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.188598 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7cb177d6-15cb-4570-aff0-de38012a120a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.190328 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7cb177d6-15cb-4570-aff0-de38012a120a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.390574 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7cb177d6-15cb-4570-aff0-de38012a120a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:32.401010 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7cb177d6-15cb-4570-aff0-de38012a120a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.232475 Jul 18 16:46:32.401823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 52/97] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:32.568936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8d07a8f9-c0db-4c81-ba34-cd989709f558 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02cfec92-d2e5-4b1a-aa52-cc433af4649a"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:32.570003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8d07a8f9-c0db-4c81-ba34-cd989709f558 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:32.591237 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7aeffc32-adb7-4aad-a351-f8f541b10522 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:32.591809 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7aeffc32-adb7-4aad-a351-f8f541b10522 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:32.595540 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8d07a8f9-c0db-4c81-ba34-cd989709f558 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.596194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8d07a8f9-c0db-4c81-ba34-cd989709f558 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.597142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8d07a8f9-c0db-4c81-ba34-cd989709f558 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.597755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8d07a8f9-c0db-4c81-ba34-cd989709f558 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.600744 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7aeffc32-adb7-4aad-a351-f8f541b10522 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.601541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7aeffc32-adb7-4aad-a351-f8f541b10522 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.604640 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7aeffc32-adb7-4aad-a351-f8f541b10522 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:32.605219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7aeffc32-adb7-4aad-a351-f8f541b10522 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:32.775885 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7aeffc32-adb7-4aad-a351-f8f541b10522 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:32.786984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7aeffc32-adb7-4aad-a351-f8f541b10522 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.200563 Jul 18 16:46:32.797615 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 53/98] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:32 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:33.418293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-897e80e6-2127-41c7-a7c3-639559ddcf95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:33.418929 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-897e80e6-2127-41c7-a7c3-639559ddcf95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:33.425022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-897e80e6-2127-41c7-a7c3-639559ddcf95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:33.425459 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-897e80e6-2127-41c7-a7c3-639559ddcf95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:33.426208 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-897e80e6-2127-41c7-a7c3-639559ddcf95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:33.426636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-897e80e6-2127-41c7-a7c3-639559ddcf95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:33.568731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-897e80e6-2127-41c7-a7c3-639559ddcf95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:33.579009 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-897e80e6-2127-41c7-a7c3-639559ddcf95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.164801 Jul 18 16:46:33.579772 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 54/99] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:33 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:33.809521 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=4 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:33.813666 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-528abcc8-27ff-4a33-8940-f8cb268030aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:33.814299 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-528abcc8-27ff-4a33-8940-f8cb268030aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:33.820843 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-528abcc8-27ff-4a33-8940-f8cb268030aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:33.821293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-528abcc8-27ff-4a33-8940-f8cb268030aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:33.824246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-528abcc8-27ff-4a33-8940-f8cb268030aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:33.824246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-528abcc8-27ff-4a33-8940-f8cb268030aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:33.970829 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-528abcc8-27ff-4a33-8940-f8cb268030aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:33.980438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-528abcc8-27ff-4a33-8940-f8cb268030aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.171545 Jul 18 16:46:33.989076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 55/100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:33 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:34.295719 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-eb5ab4c5-ba1f-4e5a-bb41-4c3dcada1443 req-0ca0f4c8-f535-4f40-b8f2-021b7257b8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed4624c-89d5-468c-bff4-3576ada7c0a9", "name": "network-vif-plugged", "status": "completed", "tag": "cc4ff60b-9404-43c6-98e9-71dd77fc67c6"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:34.304122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-eb5ab4c5-ba1f-4e5a-bb41-4c3dcada1443 req-0ca0f4c8-f535-4f40-b8f2-021b7257b8e2 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:34.304545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-eb5ab4c5-ba1f-4e5a-bb41-4c3dcada1443 req-0ca0f4c8-f535-4f40-b8f2-021b7257b8e2 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:34.316330 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-eb5ab4c5-ba1f-4e5a-bb41-4c3dcada1443 req-0ca0f4c8-f535-4f40-b8f2-021b7257b8e2 service nova] Creating event network-vif-plugged:cc4ff60b-9404-43c6-98e9-71dd77fc67c6 for instance 1ed4624c-89d5-468c-bff4-3576ada7c0a9 on hv-cinder-84617 Jul 18 16:46:34.324207 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-eb5ab4c5-ba1f-4e5a-bb41-4c3dcada1443 req-0ca0f4c8-f535-4f40-b8f2-021b7257b8e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Jul 18 16:46:34.324825 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 56/101] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:34.610630 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c98f4129-df74-438f-9b3d-959e24881ae8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:34.623058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c98f4129-df74-438f-9b3d-959e24881ae8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:34.625637 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c98f4129-df74-438f-9b3d-959e24881ae8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:34.626933 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c98f4129-df74-438f-9b3d-959e24881ae8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:34.627996 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c98f4129-df74-438f-9b3d-959e24881ae8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:34.628633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c98f4129-df74-438f-9b3d-959e24881ae8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:34.730224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8d07a8f9-c0db-4c81-ba34-cd989709f558 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "POST /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.165416 Jul 18 16:46:34.731667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 46/102] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 16:46:32 2022] POST /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f/os-volume_attachments => generated 194 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:34.831458 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c98f4129-df74-438f-9b3d-959e24881ae8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:34.842662 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c98f4129-df74-438f-9b3d-959e24881ae8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.244604 Jul 18 16:46:34.844093 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 57/103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:34 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:34.999766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-117f7d9e-8085-43f7-b628-3b13b3aaf453 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:35.000818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-117f7d9e-8085-43f7-b628-3b13b3aaf453 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:35.009385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-117f7d9e-8085-43f7-b628-3b13b3aaf453 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:35.009990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-117f7d9e-8085-43f7-b628-3b13b3aaf453 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:35.010778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-117f7d9e-8085-43f7-b628-3b13b3aaf453 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:35.011244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-117f7d9e-8085-43f7-b628-3b13b3aaf453 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:35.167177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-117f7d9e-8085-43f7-b628-3b13b3aaf453 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:35.175838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-117f7d9e-8085-43f7-b628-3b13b3aaf453 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.182713 Jul 18 16:46:35.176339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 47/104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:34 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:35.861160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec504abf-9f12-45c3-bed8-fe125d1ddbd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:35.861767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ec504abf-9f12-45c3-bed8-fe125d1ddbd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:35.869323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec504abf-9f12-45c3-bed8-fe125d1ddbd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:35.869768 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec504abf-9f12-45c3-bed8-fe125d1ddbd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:35.870533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec504abf-9f12-45c3-bed8-fe125d1ddbd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:35.870961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec504abf-9f12-45c3-bed8-fe125d1ddbd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:36.021845 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ec504abf-9f12-45c3-bed8-fe125d1ddbd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:36.029818 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ec504abf-9f12-45c3-bed8-fe125d1ddbd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.172769 Jul 18 16:46:36.030416 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 58/105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:36.201678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-64ca6ac3-bdb6-48e3-ac6e-ed80458e3a22 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:36.202307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-64ca6ac3-bdb6-48e3-ac6e-ed80458e3a22 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:36.209151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64ca6ac3-bdb6-48e3-ac6e-ed80458e3a22 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:36.209604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64ca6ac3-bdb6-48e3-ac6e-ed80458e3a22 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:36.210375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64ca6ac3-bdb6-48e3-ac6e-ed80458e3a22 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:36.210817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64ca6ac3-bdb6-48e3-ac6e-ed80458e3a22 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:36.344190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-f12be2e6-d322-4745-a382-6dbf9fd02c75 req-2cb05614-5375-4d87-b8b8-b24eb8c52305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee0085-26fb-4535-8630-6f96f19445f5", "name": "network-vif-plugged", "status": "completed", "tag": "49c5aa19-e689-4128-befe-ef9cd042860a"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:36.356351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-f12be2e6-d322-4745-a382-6dbf9fd02c75 req-2cb05614-5375-4d87-b8b8-b24eb8c52305 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:36.356834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-f12be2e6-d322-4745-a382-6dbf9fd02c75 req-2cb05614-5375-4d87-b8b8-b24eb8c52305 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:36.372861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-64ca6ac3-bdb6-48e3-ac6e-ed80458e3a22 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:36.373735 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-f12be2e6-d322-4745-a382-6dbf9fd02c75 req-2cb05614-5375-4d87-b8b8-b24eb8c52305 service nova] Creating event network-vif-plugged:49c5aa19-e689-4128-befe-ef9cd042860a for instance 7dee0085-26fb-4535-8630-6f96f19445f5 on hv-cinder-84617 Jul 18 16:46:36.379819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-f12be2e6-d322-4745-a382-6dbf9fd02c75 req-2cb05614-5375-4d87-b8b8-b24eb8c52305 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039797 Jul 18 16:46:36.380671 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 59/106] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:46:36.381232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-64ca6ac3-bdb6-48e3-ac6e-ed80458e3a22 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1322 microversion: 2.1 time: 0.191218 Jul 18 16:46:36.382122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 48/107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:36 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:37.047902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7c004604-da2e-4d20-8fb6-c6f74a7c5f7d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:37.048624 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7c004604-da2e-4d20-8fb6-c6f74a7c5f7d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:37.054933 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7c004604-da2e-4d20-8fb6-c6f74a7c5f7d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.055402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7c004604-da2e-4d20-8fb6-c6f74a7c5f7d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.056169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7c004604-da2e-4d20-8fb6-c6f74a7c5f7d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.056609 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7c004604-da2e-4d20-8fb6-c6f74a7c5f7d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.206348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7c004604-da2e-4d20-8fb6-c6f74a7c5f7d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:37.215840 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7c004604-da2e-4d20-8fb6-c6f74a7c5f7d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.172081 Jul 18 16:46:37.216788 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 60/108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:37 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:37.405126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-97427a65-d26e-44a2-a293-012709a3f415 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:37.405798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-97427a65-d26e-44a2-a293-012709a3f415 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:37.421861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97427a65-d26e-44a2-a293-012709a3f415 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.421861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97427a65-d26e-44a2-a293-012709a3f415 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.421861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97427a65-d26e-44a2-a293-012709a3f415 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.421861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97427a65-d26e-44a2-a293-012709a3f415 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.569688 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-97427a65-d26e-44a2-a293-012709a3f415 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:37.578127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-97427a65-d26e-44a2-a293-012709a3f415 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1515 microversion: 2.1 time: 0.176507 Jul 18 16:46:37.578489 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 49/109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:37 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:37.607964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a0693d52-8532-429b-8b7c-3d8b687012f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:37.610200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a0693d52-8532-429b-8b7c-3d8b687012f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:37.618087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0693d52-8532-429b-8b7c-3d8b687012f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.620471 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0693d52-8532-429b-8b7c-3d8b687012f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.620471 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0693d52-8532-429b-8b7c-3d8b687012f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:37.621008 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0693d52-8532-429b-8b7c-3d8b687012f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:37.688359 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.objects.instance [None req-a0693d52-8532-429b-8b7c-3d8b687012f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lazy-loading 'flavor' on Instance uuid 1ed4624c-89d5-468c-bff4-3576ada7c0a9 {{(pid=124945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:46:38.068981 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a0693d52-8532-429b-8b7c-3d8b687012f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "POST /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9/action" status: 200 len: 32 microversion: 2.1 time: 0.468799 Jul 18 16:46:38.087436 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 61/110] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 16:46:37 2022] POST /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9/action => generated 32 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:46:38.087632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-17680c9a-b8e7-4d26-a9fa-ac775f5c793b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:38.087632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-17680c9a-b8e7-4d26-a9fa-ac775f5c793b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:38.088214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17680c9a-b8e7-4d26-a9fa-ac775f5c793b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:38.088867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17680c9a-b8e7-4d26-a9fa-ac775f5c793b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:38.089684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17680c9a-b8e7-4d26-a9fa-ac775f5c793b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:38.090168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17680c9a-b8e7-4d26-a9fa-ac775f5c793b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:38.233826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-34ec690c-3f45-44c0-839a-c2d4451d7d7e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:38.234789 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-34ec690c-3f45-44c0-839a-c2d4451d7d7e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:38.243679 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-34ec690c-3f45-44c0-839a-c2d4451d7d7e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:38.244141 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-34ec690c-3f45-44c0-839a-c2d4451d7d7e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:38.245048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-34ec690c-3f45-44c0-839a-c2d4451d7d7e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:38.245578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-34ec690c-3f45-44c0-839a-c2d4451d7d7e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:38.299434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-17680c9a-b8e7-4d26-a9fa-ac775f5c793b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:38.311931 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-17680c9a-b8e7-4d26-a9fa-ac775f5c793b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.235445 Jul 18 16:46:38.312521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 50/111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:38 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:38.390506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-34ec690c-3f45-44c0-839a-c2d4451d7d7e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:38.398043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-34ec690c-3f45-44c0-839a-c2d4451d7d7e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.168507 Jul 18 16:46:38.398608 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 62/112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:38 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:39.329478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-67a9b179-f1b4-4365-8814-1a6dc9fd5d52 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:39.330868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-67a9b179-f1b4-4365-8814-1a6dc9fd5d52 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:39.344775 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67a9b179-f1b4-4365-8814-1a6dc9fd5d52 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:39.356603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67a9b179-f1b4-4365-8814-1a6dc9fd5d52 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:39.359075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67a9b179-f1b4-4365-8814-1a6dc9fd5d52 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:39.360316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67a9b179-f1b4-4365-8814-1a6dc9fd5d52 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:39.416713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c29fd3d8-3f14-4b9b-8a4f-8e0ab266c5f2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:39.417424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c29fd3d8-3f14-4b9b-8a4f-8e0ab266c5f2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:39.424955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c29fd3d8-3f14-4b9b-8a4f-8e0ab266c5f2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:39.425429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c29fd3d8-3f14-4b9b-8a4f-8e0ab266c5f2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:39.426398 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c29fd3d8-3f14-4b9b-8a4f-8e0ab266c5f2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:39.427029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c29fd3d8-3f14-4b9b-8a4f-8e0ab266c5f2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:39.536177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-67a9b179-f1b4-4365-8814-1a6dc9fd5d52 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:39.549135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-67a9b179-f1b4-4365-8814-1a6dc9fd5d52 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.222795 Jul 18 16:46:39.551886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 51/113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:39 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:39.676234 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c29fd3d8-3f14-4b9b-8a4f-8e0ab266c5f2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:39.686567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c29fd3d8-3f14-4b9b-8a4f-8e0ab266c5f2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.274903 Jul 18 16:46:39.687154 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 63/114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:39 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:40.570093 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4f63b692-fa44-4184-842c-df8f10bcb25a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:40.572652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4f63b692-fa44-4184-842c-df8f10bcb25a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:40.579564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f63b692-fa44-4184-842c-df8f10bcb25a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.580071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f63b692-fa44-4184-842c-df8f10bcb25a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.581036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f63b692-fa44-4184-842c-df8f10bcb25a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.581474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f63b692-fa44-4184-842c-df8f10bcb25a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.705069 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-23a2846a-6702-4f91-819d-a1d991f21c81 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:40.706276 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-23a2846a-6702-4f91-819d-a1d991f21c81 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:40.716729 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23a2846a-6702-4f91-819d-a1d991f21c81 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.718592 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23a2846a-6702-4f91-819d-a1d991f21c81 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.720077 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23a2846a-6702-4f91-819d-a1d991f21c81 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:40.720777 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23a2846a-6702-4f91-819d-a1d991f21c81 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:40.745609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f63b692-fa44-4184-842c-df8f10bcb25a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:40.755948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4f63b692-fa44-4184-842c-df8f10bcb25a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.189373 Jul 18 16:46:40.756739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 52/115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:40 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:40.757423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:40.906574 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-23a2846a-6702-4f91-819d-a1d991f21c81 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:40.914026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-23a2846a-6702-4f91-819d-a1d991f21c81 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.213773 Jul 18 16:46:40.915311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 64/116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:40 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:41.773590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-82383b51-eee1-4cd2-9743-762015bba8ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:41.778376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-82383b51-eee1-4cd2-9743-762015bba8ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:41.781174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82383b51-eee1-4cd2-9743-762015bba8ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:41.781633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82383b51-eee1-4cd2-9743-762015bba8ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:41.782405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82383b51-eee1-4cd2-9743-762015bba8ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:41.782844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82383b51-eee1-4cd2-9743-762015bba8ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:41.931766 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-af62decf-8cea-4f58-aab3-408ce6167b4a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:41.933271 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-af62decf-8cea-4f58-aab3-408ce6167b4a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:41.938916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-82383b51-eee1-4cd2-9743-762015bba8ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:41.939216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-af62decf-8cea-4f58-aab3-408ce6167b4a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:41.939881 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-af62decf-8cea-4f58-aab3-408ce6167b4a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:41.941027 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-af62decf-8cea-4f58-aab3-408ce6167b4a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:41.941136 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-af62decf-8cea-4f58-aab3-408ce6167b4a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:41.947338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-82383b51-eee1-4cd2-9743-762015bba8ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.177300 Jul 18 16:46:41.948189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 53/117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:41 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:42.089791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-af62decf-8cea-4f58-aab3-408ce6167b4a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:42.097745 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-af62decf-8cea-4f58-aab3-408ce6167b4a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.170681 Jul 18 16:46:42.098334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 65/118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:41 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:42.967763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-61b15dbe-5e97-431a-bbae-8ca070ebd23f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:42.968562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-61b15dbe-5e97-431a-bbae-8ca070ebd23f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:42.975816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61b15dbe-5e97-431a-bbae-8ca070ebd23f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:42.976267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61b15dbe-5e97-431a-bbae-8ca070ebd23f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:42.977035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61b15dbe-5e97-431a-bbae-8ca070ebd23f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:42.977673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61b15dbe-5e97-431a-bbae-8ca070ebd23f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:43.115999 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7716f6ac-94a0-4a0b-8b5f-4c7d607c61f6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:43.116613 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7716f6ac-94a0-4a0b-8b5f-4c7d607c61f6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:43.126067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7716f6ac-94a0-4a0b-8b5f-4c7d607c61f6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:43.126577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7716f6ac-94a0-4a0b-8b5f-4c7d607c61f6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:43.127423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7716f6ac-94a0-4a0b-8b5f-4c7d607c61f6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:43.127894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7716f6ac-94a0-4a0b-8b5f-4c7d607c61f6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:43.131315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-61b15dbe-5e97-431a-bbae-8ca070ebd23f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:43.140579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-61b15dbe-5e97-431a-bbae-8ca070ebd23f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.177263 Jul 18 16:46:43.147526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 54/119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:42 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:43.420479 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7716f6ac-94a0-4a0b-8b5f-4c7d607c61f6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:43.437497 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7716f6ac-94a0-4a0b-8b5f-4c7d607c61f6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1363 microversion: 2.1 time: 0.325177 Jul 18 16:46:43.439061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 66/120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:43 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:44.163991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-27f090bb-043d-44c8-86ee-a79b65667fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:44.165908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-27f090bb-043d-44c8-86ee-a79b65667fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:44.174018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27f090bb-043d-44c8-86ee-a79b65667fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:44.174466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27f090bb-043d-44c8-86ee-a79b65667fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.175303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27f090bb-043d-44c8-86ee-a79b65667fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:44.175769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27f090bb-043d-44c8-86ee-a79b65667fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.343294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-27f090bb-043d-44c8-86ee-a79b65667fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:44.353813 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-27f090bb-043d-44c8-86ee-a79b65667fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.192641 Jul 18 16:46:44.354572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 55/121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:44 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:44.472226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0c6df780-579b-4e40-9e20-f221de15d445 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:44.472880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0c6df780-579b-4e40-9e20-f221de15d445 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:44.486015 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0c6df780-579b-4e40-9e20-f221de15d445 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:44.486015 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0c6df780-579b-4e40-9e20-f221de15d445 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.486015 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0c6df780-579b-4e40-9e20-f221de15d445 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:44.486015 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0c6df780-579b-4e40-9e20-f221de15d445 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.636639 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0c6df780-579b-4e40-9e20-f221de15d445 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:44.647143 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0c6df780-579b-4e40-9e20-f221de15d445 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1550 microversion: 2.1 time: 0.178670 Jul 18 16:46:44.648150 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 67/122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:44 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1550 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:44.670660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-09d042f0-cf3c-4899-89a1-fa02abaf19e9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:44.671147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-09d042f0-cf3c-4899-89a1-fa02abaf19e9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:44.677399 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09d042f0-cf3c-4899-89a1-fa02abaf19e9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:44.677834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09d042f0-cf3c-4899-89a1-fa02abaf19e9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.678762 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09d042f0-cf3c-4899-89a1-fa02abaf19e9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:44.679020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09d042f0-cf3c-4899-89a1-fa02abaf19e9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:44.822344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-09d042f0-cf3c-4899-89a1-fa02abaf19e9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156048 Jul 18 16:46:44.823071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 56/123] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 18 16:46:44 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:45.373854 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-09a670d3-52ee-4b38-b2e8-f30a29b2e9c6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:45.374693 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-09a670d3-52ee-4b38-b2e8-f30a29b2e9c6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:45.381994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09a670d3-52ee-4b38-b2e8-f30a29b2e9c6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:45.385798 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09a670d3-52ee-4b38-b2e8-f30a29b2e9c6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:45.387768 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09a670d3-52ee-4b38-b2e8-f30a29b2e9c6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:45.388443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09a670d3-52ee-4b38-b2e8-f30a29b2e9c6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:45.647731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-09a670d3-52ee-4b38-b2e8-f30a29b2e9c6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:45.666000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-09a670d3-52ee-4b38-b2e8-f30a29b2e9c6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.295958 Jul 18 16:46:45.666585 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 68/124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:45 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:46.693978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fc316326-2d73-4f7a-abce-f916ff11c096 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:46.694579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fc316326-2d73-4f7a-abce-f916ff11c096 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:46.730458 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-61345b82-6cbb-43eb-81ee-83f4419fdfeb req-1a59876c-c018-4151-99c4-95169dde1efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dee0085-26fb-4535-8630-6f96f19445f5", "tag": "49c5aa19-e689-4128-befe-ef9cd042860a"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:46.741255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-61345b82-6cbb-43eb-81ee-83f4419fdfeb req-1a59876c-c018-4151-99c4-95169dde1efd service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:46.741705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-61345b82-6cbb-43eb-81ee-83f4419fdfeb req-1a59876c-c018-4151-99c4-95169dde1efd service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:46.752841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fc316326-2d73-4f7a-abce-f916ff11c096 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:46.755592 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-61345b82-6cbb-43eb-81ee-83f4419fdfeb req-1a59876c-c018-4151-99c4-95169dde1efd service nova] Creating event network-changed:49c5aa19-e689-4128-befe-ef9cd042860a for instance 7dee0085-26fb-4535-8630-6f96f19445f5 on hv-cinder-84617 Jul 18 16:46:46.764123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fc316326-2d73-4f7a-abce-f916ff11c096 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:46.764740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-61345b82-6cbb-43eb-81ee-83f4419fdfeb req-1a59876c-c018-4151-99c4-95169dde1efd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038318 Jul 18 16:46:46.765000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fc316326-2d73-4f7a-abce-f916ff11c096 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:46.766188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 69/125] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:46.770324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fc316326-2d73-4f7a-abce-f916ff11c096 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:46.774081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:47.269009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fc316326-2d73-4f7a-abce-f916ff11c096 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:47.280906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fc316326-2d73-4f7a-abce-f916ff11c096 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.591597 Jul 18 16:46:47.282400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 57/126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:46 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:48.313395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8902fbb3-b218-4e71-b1aa-c98ec395aadb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:48.318001 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8902fbb3-b218-4e71-b1aa-c98ec395aadb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:48.329242 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:48.334088 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8902fbb3-b218-4e71-b1aa-c98ec395aadb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:48.334857 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8902fbb3-b218-4e71-b1aa-c98ec395aadb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:48.337266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8902fbb3-b218-4e71-b1aa-c98ec395aadb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:48.338877 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8902fbb3-b218-4e71-b1aa-c98ec395aadb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:48.551747 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8902fbb3-b218-4e71-b1aa-c98ec395aadb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:48.563741 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8902fbb3-b218-4e71-b1aa-c98ec395aadb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.260448 Jul 18 16:46:48.574169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 70/127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:48 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:49.580976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-80782884-b8ba-4d64-928b-8df2fddfdd66 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:49.581945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-80782884-b8ba-4d64-928b-8df2fddfdd66 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:49.589940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=64 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:46:49.597189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-80782884-b8ba-4d64-928b-8df2fddfdd66 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:49.597970 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-80782884-b8ba-4d64-928b-8df2fddfdd66 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:49.599077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-80782884-b8ba-4d64-928b-8df2fddfdd66 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:49.599544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-80782884-b8ba-4d64-928b-8df2fddfdd66 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:49.835365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-80782884-b8ba-4d64-928b-8df2fddfdd66 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:49.845694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-80782884-b8ba-4d64-928b-8df2fddfdd66 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.268463 Jul 18 16:46:49.846326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 58/128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:49 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:50.874020 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f89247a7-7ff4-4ef7-9d51-e31b3f57d6cd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:50.876005 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f89247a7-7ff4-4ef7-9d51-e31b3f57d6cd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:50.900124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f89247a7-7ff4-4ef7-9d51-e31b3f57d6cd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:50.900124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f89247a7-7ff4-4ef7-9d51-e31b3f57d6cd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:50.900124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f89247a7-7ff4-4ef7-9d51-e31b3f57d6cd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:50.900124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f89247a7-7ff4-4ef7-9d51-e31b3f57d6cd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:51.294337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f89247a7-7ff4-4ef7-9d51-e31b3f57d6cd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:51.320040 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f89247a7-7ff4-4ef7-9d51-e31b3f57d6cd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.458258 Jul 18 16:46:51.321050 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 71/129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:50 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:51.520090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ff4e8ae5-4056-4dcb-ba32-a74b909ab5cb tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:51.521812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ff4e8ae5-4056-4dcb-ba32-a74b909ab5cb tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:51.534936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff4e8ae5-4056-4dcb-ba32-a74b909ab5cb tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:51.535797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff4e8ae5-4056-4dcb-ba32-a74b909ab5cb tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:51.536762 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff4e8ae5-4056-4dcb-ba32-a74b909ab5cb tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:51.537380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff4e8ae5-4056-4dcb-ba32-a74b909ab5cb tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:51.601428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ff4e8ae5-4056-4dcb-ba32-a74b909ab5cb tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:46:52.085036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ff4e8ae5-4056-4dcb-ba32-a74b909ab5cb tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 204 len: 0 microversion: 2.1 time: 0.578342 Jul 18 16:46:52.087605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 59/130] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 16:46:51 2022] DELETE /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:46:52.097014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-02ce26b5-a221-4329-92b5-58ef625ec908 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:52.097610 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-02ce26b5-a221-4329-92b5-58ef625ec908 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:52.104878 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-02ce26b5-a221-4329-92b5-58ef625ec908 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:52.105317 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-02ce26b5-a221-4329-92b5-58ef625ec908 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:52.106292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-02ce26b5-a221-4329-92b5-58ef625ec908 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:52.107760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-02ce26b5-a221-4329-92b5-58ef625ec908 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:52.338585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-71ef9bc7-f59f-40dc-be60-124f4f493a03 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:52.340528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-71ef9bc7-f59f-40dc-be60-124f4f493a03 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:52.346706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-71ef9bc7-f59f-40dc-be60-124f4f493a03 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:52.347039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-71ef9bc7-f59f-40dc-be60-124f4f493a03 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:52.347834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-71ef9bc7-f59f-40dc-be60-124f4f493a03 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:52.348266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-71ef9bc7-f59f-40dc-be60-124f4f493a03 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:52.428477 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-02ce26b5-a221-4329-92b5-58ef625ec908 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:52.438960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-02ce26b5-a221-4329-92b5-58ef625ec908 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1554 microversion: 2.1 time: 0.345603 Jul 18 16:46:52.439723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 72/131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:52 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1554 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:52.512618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-71ef9bc7-f59f-40dc-be60-124f4f493a03 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:52.525457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-71ef9bc7-f59f-40dc-be60-124f4f493a03 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.191159 Jul 18 16:46:52.526543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 60/132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:52 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:53.462909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7f105472-ee13-4a6c-b04a-08f5fbc23840 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:53.463671 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7f105472-ee13-4a6c-b04a-08f5fbc23840 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:53.470554 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f105472-ee13-4a6c-b04a-08f5fbc23840 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:53.471262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f105472-ee13-4a6c-b04a-08f5fbc23840 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:53.472413 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f105472-ee13-4a6c-b04a-08f5fbc23840 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:53.473010 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f105472-ee13-4a6c-b04a-08f5fbc23840 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:53.543642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4d3816da-edb6-46ed-9f19-39383308cd37 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:53.544274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4d3816da-edb6-46ed-9f19-39383308cd37 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:53.562019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d3816da-edb6-46ed-9f19-39383308cd37 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:53.562714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d3816da-edb6-46ed-9f19-39383308cd37 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:53.563777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d3816da-edb6-46ed-9f19-39383308cd37 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:53.564418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d3816da-edb6-46ed-9f19-39383308cd37 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:53.676499 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7f105472-ee13-4a6c-b04a-08f5fbc23840 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:53.692123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7f105472-ee13-4a6c-b04a-08f5fbc23840 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1554 microversion: 2.1 time: 0.233358 Jul 18 16:46:53.692123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 73/133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:53 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:53.829138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4d3816da-edb6-46ed-9f19-39383308cd37 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:53.843160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4d3816da-edb6-46ed-9f19-39383308cd37 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.301145 Jul 18 16:46:53.844233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 61/134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:53 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:54.714581 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3e08a20f-e1e6-4b6b-9a68-5eb346ebbae9 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:54.716399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3e08a20f-e1e6-4b6b-9a68-5eb346ebbae9 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:54.725903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e08a20f-e1e6-4b6b-9a68-5eb346ebbae9 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.727799 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e08a20f-e1e6-4b6b-9a68-5eb346ebbae9 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.729892 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e08a20f-e1e6-4b6b-9a68-5eb346ebbae9 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.730588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e08a20f-e1e6-4b6b-9a68-5eb346ebbae9 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.860963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c9c01ef1-c62e-47f9-b67d-4e2cde5cfcd3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:54.861674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c9c01ef1-c62e-47f9-b67d-4e2cde5cfcd3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:54.872980 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9c01ef1-c62e-47f9-b67d-4e2cde5cfcd3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.873828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9c01ef1-c62e-47f9-b67d-4e2cde5cfcd3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.874908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9c01ef1-c62e-47f9-b67d-4e2cde5cfcd3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:54.875583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9c01ef1-c62e-47f9-b67d-4e2cde5cfcd3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:54.945374 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3e08a20f-e1e6-4b6b-9a68-5eb346ebbae9 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:54.954565 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3e08a20f-e1e6-4b6b-9a68-5eb346ebbae9 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1554 microversion: 2.1 time: 0.244315 Jul 18 16:46:54.955624 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 74/135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:54 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1554 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:55.495181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c9c01ef1-c62e-47f9-b67d-4e2cde5cfcd3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:55.520573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c9c01ef1-c62e-47f9-b67d-4e2cde5cfcd3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.659667 Jul 18 16:46:55.520573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 62/136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:54 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:46:55.980555 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8fe9a31f-7b17-4268-9a39-aea7bbe7b7a4 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:55.981663 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8fe9a31f-7b17-4268-9a39-aea7bbe7b7a4 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:56.011265 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8fe9a31f-7b17-4268-9a39-aea7bbe7b7a4 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:56.011738 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8fe9a31f-7b17-4268-9a39-aea7bbe7b7a4 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:56.012660 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8fe9a31f-7b17-4268-9a39-aea7bbe7b7a4 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:56.013433 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8fe9a31f-7b17-4268-9a39-aea7bbe7b7a4 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:56.139548 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8fe9a31f-7b17-4268-9a39-aea7bbe7b7a4 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:56.156970 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8fe9a31f-7b17-4268-9a39-aea7bbe7b7a4 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1512 microversion: 2.1 time: 0.183494 Jul 18 16:46:56.157563 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 75/137] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:55 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:56.192108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-46ad7d26-47fb-4a22-8091-a450f9d81333 req-72ed7723-7a22-4ff4-ab00-5b99478e6be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a3169eb-4570-46ca-84a2-8226e855da0f", "name": "network-vif-deleted", "tag": "8ab03ff1-5bf8-4c2d-b3e6-cfe01ca0c3bd"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:46:56.201343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-46ad7d26-47fb-4a22-8091-a450f9d81333 req-72ed7723-7a22-4ff4-ab00-5b99478e6be4 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:56.201793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-46ad7d26-47fb-4a22-8091-a450f9d81333 req-72ed7723-7a22-4ff4-ab00-5b99478e6be4 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:56.215140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-46ad7d26-47fb-4a22-8091-a450f9d81333 req-72ed7723-7a22-4ff4-ab00-5b99478e6be4 service nova] Creating event network-vif-deleted:8ab03ff1-5bf8-4c2d-b3e6-cfe01ca0c3bd for instance 9a3169eb-4570-46ca-84a2-8226e855da0f on hv-cinder-84617 Jul 18 16:46:56.220801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-46ad7d26-47fb-4a22-8091-a450f9d81333 req-72ed7723-7a22-4ff4-ab00-5b99478e6be4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032574 Jul 18 16:46:56.233673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 63/138] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:46:56.534000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-455cf99a-711d-45ce-8129-4598f66a7965 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:56.534523 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-455cf99a-711d-45ce-8129-4598f66a7965 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:56.542259 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-455cf99a-711d-45ce-8129-4598f66a7965 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:56.542646 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-455cf99a-711d-45ce-8129-4598f66a7965 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:56.543621 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-455cf99a-711d-45ce-8129-4598f66a7965 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:56.544058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-455cf99a-711d-45ce-8129-4598f66a7965 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:56.714653 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-455cf99a-711d-45ce-8129-4598f66a7965 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:56.724902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-455cf99a-711d-45ce-8129-4598f66a7965 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.194723 Jul 18 16:46:56.725835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 76/139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:56 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:57.178869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d8b142ea-93d0-4349-98d0-46244ff2f3fe tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:57.180030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d8b142ea-93d0-4349-98d0-46244ff2f3fe tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:57.187690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8b142ea-93d0-4349-98d0-46244ff2f3fe tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:57.188204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8b142ea-93d0-4349-98d0-46244ff2f3fe tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:57.189148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8b142ea-93d0-4349-98d0-46244ff2f3fe tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:57.189734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8b142ea-93d0-4349-98d0-46244ff2f3fe tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:57.294660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d8b142ea-93d0-4349-98d0-46244ff2f3fe tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:57.303480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d8b142ea-93d0-4349-98d0-46244ff2f3fe tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1345 microversion: 2.1 time: 0.132461 Jul 18 16:46:57.313249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 64/140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:57 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:57.744717 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7a677aca-4c01-4cfb-a67e-2130a76fa689 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:57.745383 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7a677aca-4c01-4cfb-a67e-2130a76fa689 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:57.753415 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a677aca-4c01-4cfb-a67e-2130a76fa689 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:57.753865 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a677aca-4c01-4cfb-a67e-2130a76fa689 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:57.755187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a677aca-4c01-4cfb-a67e-2130a76fa689 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:57.755770 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a677aca-4c01-4cfb-a67e-2130a76fa689 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:57.957772 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7a677aca-4c01-4cfb-a67e-2130a76fa689 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:57.976041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7a677aca-4c01-4cfb-a67e-2130a76fa689 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.237024 Jul 18 16:46:57.980748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 77/141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:57 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:58.325227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-693a944e-8bf9-4466-9224-4b27f8e559bf tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:58.326552 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-693a944e-8bf9-4466-9224-4b27f8e559bf tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:58.351023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-693a944e-8bf9-4466-9224-4b27f8e559bf tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:58.351023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-693a944e-8bf9-4466-9224-4b27f8e559bf tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:58.351023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-693a944e-8bf9-4466-9224-4b27f8e559bf tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:58.351023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-693a944e-8bf9-4466-9224-4b27f8e559bf tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:58.422833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-693a944e-8bf9-4466-9224-4b27f8e559bf tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:58.431954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-693a944e-8bf9-4466-9224-4b27f8e559bf tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1345 microversion: 2.1 time: 0.112417 Jul 18 16:46:58.432529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 65/142] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:58 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:58.994196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d527c8ef-fd9b-4d36-bc2e-d3ee59d12abe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:59.002410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d527c8ef-fd9b-4d36-bc2e-d3ee59d12abe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:59.002410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d527c8ef-fd9b-4d36-bc2e-d3ee59d12abe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:59.002410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d527c8ef-fd9b-4d36-bc2e-d3ee59d12abe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:59.002410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d527c8ef-fd9b-4d36-bc2e-d3ee59d12abe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:59.002802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d527c8ef-fd9b-4d36-bc2e-d3ee59d12abe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:59.168463 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d527c8ef-fd9b-4d36-bc2e-d3ee59d12abe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:59.177037 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d527c8ef-fd9b-4d36-bc2e-d3ee59d12abe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.187545 Jul 18 16:46:59.177722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 78/143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:58 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:46:59.450464 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c128e1e6-07a5-415a-b315-e5e231ff8647 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:46:59.451716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c128e1e6-07a5-415a-b315-e5e231ff8647 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:46:59.465261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c128e1e6-07a5-415a-b315-e5e231ff8647 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:59.467861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c128e1e6-07a5-415a-b315-e5e231ff8647 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:59.468649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c128e1e6-07a5-415a-b315-e5e231ff8647 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:46:59.469081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c128e1e6-07a5-415a-b315-e5e231ff8647 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:46:59.591873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c128e1e6-07a5-415a-b315-e5e231ff8647 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:46:59.603218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c128e1e6-07a5-415a-b315-e5e231ff8647 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1345 microversion: 2.1 time: 0.157403 Jul 18 16:46:59.604496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 66/144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:46:59 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:00.202965 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-572dc7ae-5ce1-45a9-9ffd-279786a17e94 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:00.204804 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-572dc7ae-5ce1-45a9-9ffd-279786a17e94 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:00.220900 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-572dc7ae-5ce1-45a9-9ffd-279786a17e94 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:00.224902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-572dc7ae-5ce1-45a9-9ffd-279786a17e94 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:00.225968 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-572dc7ae-5ce1-45a9-9ffd-279786a17e94 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:00.226569 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-572dc7ae-5ce1-45a9-9ffd-279786a17e94 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:00.557331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-572dc7ae-5ce1-45a9-9ffd-279786a17e94 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:00.566846 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-572dc7ae-5ce1-45a9-9ffd-279786a17e94 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.376078 Jul 18 16:47:00.567429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 79/145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:00 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:00.625802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-efdb6bdb-1c67-42ae-884f-b74c10a2ff94 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:00.626419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-efdb6bdb-1c67-42ae-884f-b74c10a2ff94 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:00.633688 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-efdb6bdb-1c67-42ae-884f-b74c10a2ff94 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:00.634189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-efdb6bdb-1c67-42ae-884f-b74c10a2ff94 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:00.634978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-efdb6bdb-1c67-42ae-884f-b74c10a2ff94 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:00.635417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-efdb6bdb-1c67-42ae-884f-b74c10a2ff94 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:00.758824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-efdb6bdb-1c67-42ae-884f-b74c10a2ff94 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:00.775335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-efdb6bdb-1c67-42ae-884f-b74c10a2ff94 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1345 microversion: 2.1 time: 0.154061 Jul 18 16:47:00.778653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 67/146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:00 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:01.598617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f7fb2eaf-bf76-494a-92ac-3f1c808948ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:01.599291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f7fb2eaf-bf76-494a-92ac-3f1c808948ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:01.611744 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f7fb2eaf-bf76-494a-92ac-3f1c808948ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.612427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f7fb2eaf-bf76-494a-92ac-3f1c808948ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.613310 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f7fb2eaf-bf76-494a-92ac-3f1c808948ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.616760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f7fb2eaf-bf76-494a-92ac-3f1c808948ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.796637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-50969a86-b12e-40e0-8080-e00f2cb91e70 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:01.798892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-50969a86-b12e-40e0-8080-e00f2cb91e70 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:01.811870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50969a86-b12e-40e0-8080-e00f2cb91e70 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.831780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50969a86-b12e-40e0-8080-e00f2cb91e70 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.836197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50969a86-b12e-40e0-8080-e00f2cb91e70 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:01.837226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50969a86-b12e-40e0-8080-e00f2cb91e70 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:01.921957 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f7fb2eaf-bf76-494a-92ac-3f1c808948ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:01.944256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f7fb2eaf-bf76-494a-92ac-3f1c808948ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.348031 Jul 18 16:47:01.945862 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 80/147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:01 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:02.004958 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-50969a86-b12e-40e0-8080-e00f2cb91e70 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:02.018614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-50969a86-b12e-40e0-8080-e00f2cb91e70 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1345 microversion: 2.1 time: 0.227648 Jul 18 16:47:02.019194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 68/148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:01 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1345 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:47:02.973999 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e32b468d-25cd-4ffd-92b5-1624b5e03bb6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:02.975992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e32b468d-25cd-4ffd-92b5-1624b5e03bb6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:02.990998 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e32b468d-25cd-4ffd-92b5-1624b5e03bb6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:02.992741 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e32b468d-25cd-4ffd-92b5-1624b5e03bb6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:02.996040 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e32b468d-25cd-4ffd-92b5-1624b5e03bb6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:02.996731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e32b468d-25cd-4ffd-92b5-1624b5e03bb6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.038659 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:03.039978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:03.049673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.050478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.051828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.052499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.095454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:03.097786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:03.097786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lazy-loading 'fault' on Instance uuid 9a3169eb-4570-46ca-84a2-8226e855da0f {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:47:03.163866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87094997b3b94ebea3de60446795fb7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540cf87ca5364bf598ab16cdc3903a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:03.172110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e32b468d-25cd-4ffd-92b5-1624b5e03bb6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:03.174229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-59cd9d68-c824-4abc-93de-c6eb62c3e9af tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 200 len: 1350 microversion: 2.1 time: 0.142241 Jul 18 16:47:03.183860 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:03.185160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 69/149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:03 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:03.187229 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e32b468d-25cd-4ffd-92b5-1624b5e03bb6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.227672 Jul 18 16:47:03.187848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 81/150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:02 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:04.192198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:04.192951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:04.200611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.201052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.201817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.202344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.215217 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-51f358f4-729f-40c3-85ab-899e88968561 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:04.216040 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-51f358f4-729f-40c3-85ab-899e88968561 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:04.226176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-51f358f4-729f-40c3-85ab-899e88968561 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.227133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-51f358f4-729f-40c3-85ab-899e88968561 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.228494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-51f358f4-729f-40c3-85ab-899e88968561 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.230104 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-51f358f4-729f-40c3-85ab-899e88968561 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.230977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] HTTP exception thrown: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Request method failure captured: Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f HTTP/1.1 Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y4-Ti-ySQBY4CeiYSJ-1Er9PiKQowHxXfSAMUO0fCue0qeltis1LjJBgqN3-H7dkoVYa6uPQCG2JE9mkpmUQzyr46ZjC48OrphRWBchpj52a4e-J4LTnTJqUS6oge4ucAtVIo2viesBv7-6__CHeGRY-zQfAhPhHsyB9KLCxYHKUGY Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 540cf87ca5364bf598ab16cdc3903a1c Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 16:47:04.249189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/540cf87ca5364bf598ab16cdc3903a1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_540cf87ca5364bf598ab16cdc3903a1c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/540cf87ca5364bf598ab16cdc3903a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/540cf87ca5364bf598ab16cdc3903a1c"}]}] Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 540cf87ca5364bf598ab16cdc3903a1c Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-DeleteServersTestJSON-1323063587-project Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 87094997b3b94ebea3de60446795fb7a Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-DeleteServersTestJSON-1323063587-project Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.251105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '9a3169eb-4570-46ca-84a2-8226e855da0f'} Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:04.251942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.253496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.254638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Returning 404 to user: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:04.254638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-eade712d-f156-424b-9f97-dc1f49c7f663 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 404 len: 111 microversion: 2.1 time: 0.062500 Jul 18 16:47:04.254638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 70/151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:04 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:04.418142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:04.419456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:04.434941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.435600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.436522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:04.437070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:04.470430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] HTTP exception thrown: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Request method failure captured: Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f/os-volume_attachments HTTP/1.1 Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y4-Ti-ySQBY4CeiYSJ-1Er9PiKQowHxXfSAMUO0fCue0qeltis1LjJBgqN3-H7dkoVYa6uPQCG2JE9mkpmUQzyr46ZjC48OrphRWBchpj52a4e-J4LTnTJqUS6oge4ucAtVIo2viesBv7-6__CHeGRY-zQfAhPhHsyB9KLCxYHKUGY Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 540cf87ca5364bf598ab16cdc3903a1c Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 16:47:04.475280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/540cf87ca5364bf598ab16cdc3903a1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_540cf87ca5364bf598ab16cdc3903a1c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/540cf87ca5364bf598ab16cdc3903a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/540cf87ca5364bf598ab16cdc3903a1c"}]}] Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 540cf87ca5364bf598ab16cdc3903a1c Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-DeleteServersTestJSON-1323063587-project Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 87094997b3b94ebea3de60446795fb7a Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-DeleteServersTestJSON-1323063587-project Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.476868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'server_id': '9a3169eb-4570-46ca-84a2-8226e855da0f'} Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:04.478101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:04.479612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:04.482033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Returning 404 to user: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:04.483041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6555518a-8660-4f34-901e-466e7f29e60d tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073367 Jul 18 16:47:04.486671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 71/152] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:47:04 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f/os-volume_attachments => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 16:47:04.507573 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-51f358f4-729f-40c3-85ab-899e88968561 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:04.526730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-51f358f4-729f-40c3-85ab-899e88968561 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.315735 Jul 18 16:47:04.527673 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 82/153] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:04 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:05.546921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8c4f1358-bceb-4fca-9868-298472ee7a59 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:05.548322 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8c4f1358-bceb-4fca-9868-298472ee7a59 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:05.557329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8c4f1358-bceb-4fca-9868-298472ee7a59 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:05.557992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8c4f1358-bceb-4fca-9868-298472ee7a59 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:05.558996 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8c4f1358-bceb-4fca-9868-298472ee7a59 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:05.559638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8c4f1358-bceb-4fca-9868-298472ee7a59 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:05.742467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-27d8cd3a-2eee-45b2-bbea-c77e8126c0ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Action: 'create', calling method: .version_select at 0x7fd6ae21a790>, body: {"keypair": {"name": "tempest-TestShelveInstance-305916691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaug+OqNwQOaRRiYQ+g8u8jsw3kit484TOJF97+1KHoLpEr2EqhIoI5jzDYxBmMMRlxapNy1PyzoPEBhAWszr1xal54E/F/oVm1whhD2XlJOxDtxpdqn1mB7OL8AfXPUg=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:47:05.765777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-27d8cd3a-2eee-45b2-bbea-c77e8126c0ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Getting quotas for project 5d70fe1437fc423681962ee747f07410. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:47:05.770824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-27d8cd3a-2eee-45b2-bbea-c77e8126c0ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Getting quotas for user 6472100830a54d6a8e21ee55b68e6a02 and project 5d70fe1437fc423681962ee747f07410. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:47:05.788227 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8c4f1358-bceb-4fca-9868-298472ee7a59 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:05.800801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8c4f1358-bceb-4fca-9868-298472ee7a59 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.260639 Jul 18 16:47:05.804004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 83/154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:05 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:47:05.951771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-27d8cd3a-2eee-45b2-bbea-c77e8126c0ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.602920 Jul 18 16:47:05.952645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 72/155] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 16:47:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:06.242633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:06.242633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:06.253621 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:06.257580 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:06.257580 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:06.257580 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:06.275826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] HTTP exception thrown: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Request method failure captured: Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: DELETE /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f HTTP/1.1 Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y4-Ti-ySQBY4CeiYSJ-1Er9PiKQowHxXfSAMUO0fCue0qeltis1LjJBgqN3-H7dkoVYa6uPQCG2JE9mkpmUQzyr46ZjC48OrphRWBchpj52a4e-J4LTnTJqUS6oge4ucAtVIo2viesBv7-6__CHeGRY-zQfAhPhHsyB9KLCxYHKUGY Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 540cf87ca5364bf598ab16cdc3903a1c Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:47:06.281424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/540cf87ca5364bf598ab16cdc3903a1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_540cf87ca5364bf598ab16cdc3903a1c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/540cf87ca5364bf598ab16cdc3903a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/540cf87ca5364bf598ab16cdc3903a1c"}]}] Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 540cf87ca5364bf598ab16cdc3903a1c Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-DeleteServersTestJSON-1323063587-project Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: 87094997b3b94ebea3de60446795fb7a Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-DeleteServersTestJSON-1323063587-project Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: > Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.282667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'id': '9a3169eb-4570-46ca-84a2-8226e855da0f'} Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:06.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.284386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.291381 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Returning 404 to user: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:06.292803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2517ae8d-6fba-4fdf-84aa-38c17b70ceb0 tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 404 len: 111 microversion: 2.1 time: 0.056188 Jul 18 16:47:06.293585 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 84/156] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 16:47:06 2022] DELETE /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:06.303092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:06.304039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] [instance: 9a3169eb-4570-46ca-84a2-8226e855da0f] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:06.313468 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:06.314051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:06.316185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:06.317284 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:06.335379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] HTTP exception thrown: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Request method failure captured: Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f HTTP/1.1 Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y4-Ti-ySQBY4CeiYSJ-1Er9PiKQowHxXfSAMUO0fCue0qeltis1LjJBgqN3-H7dkoVYa6uPQCG2JE9mkpmUQzyr46ZjC48OrphRWBchpj52a4e-J4LTnTJqUS6oge4ucAtVIo2viesBv7-6__CHeGRY-zQfAhPhHsyB9KLCxYHKUGY Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 540cf87ca5364bf598ab16cdc3903a1c Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 16:47:06.337173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/540cf87ca5364bf598ab16cdc3903a1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_540cf87ca5364bf598ab16cdc3903a1c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/540cf87ca5364bf598ab16cdc3903a1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/540cf87ca5364bf598ab16cdc3903a1c"}]}] Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 540cf87ca5364bf598ab16cdc3903a1c Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-DeleteServersTestJSON-1323063587 Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-DeleteServersTestJSON-1323063587-project Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 87094997b3b94ebea3de60446795fb7a Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-DeleteServersTestJSON-1323063587-project Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.338568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '9a3169eb-4570-46ca-84a2-8226e855da0f'} Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:47:06.339366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. Jul 18 16:47:06.344514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 16:47:06.346514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] Returning 404 to user: Instance 9a3169eb-4570-46ca-84a2-8226e855da0f could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:47:06.346514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d97a83f7-d496-40e8-bd42-553db3eb170b tempest-DeleteServersTestJSON-1323063587 tempest-DeleteServersTestJSON-1323063587-project] 10.222.0.26 "GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f" status: 404 len: 111 microversion: 2.1 time: 0.042296 Jul 18 16:47:06.346514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 73/157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:06 2022] GET /compute/v2.1/servers/9a3169eb-4570-46ca-84a2-8226e855da0f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:47:06.828687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-89b879ff-e3f8-4675-8e86-71dcd7e25bb3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:06.829962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-89b879ff-e3f8-4675-8e86-71dcd7e25bb3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:06.836989 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-89b879ff-e3f8-4675-8e86-71dcd7e25bb3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:06.837600 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-89b879ff-e3f8-4675-8e86-71dcd7e25bb3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:06.838869 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-89b879ff-e3f8-4675-8e86-71dcd7e25bb3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:06.839408 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-89b879ff-e3f8-4675-8e86-71dcd7e25bb3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:07.018248 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-89b879ff-e3f8-4675-8e86-71dcd7e25bb3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:07.048029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-89b879ff-e3f8-4675-8e86-71dcd7e25bb3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.223903 Jul 18 16:47:07.051213 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 85/158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:06 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:47:08.067421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-768f50f3-0063-4e2e-a430-f4bdfb9801e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:08.068720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-768f50f3-0063-4e2e-a430-f4bdfb9801e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:08.081934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-768f50f3-0063-4e2e-a430-f4bdfb9801e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:08.088271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-768f50f3-0063-4e2e-a430-f4bdfb9801e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:08.089367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-768f50f3-0063-4e2e-a430-f4bdfb9801e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:08.089968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-768f50f3-0063-4e2e-a430-f4bdfb9801e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:08.352406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-768f50f3-0063-4e2e-a430-f4bdfb9801e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:08.379691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-768f50f3-0063-4e2e-a430-f4bdfb9801e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.310776 Jul 18 16:47:08.379691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 74/159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:08 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:09.393647 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5a1acfa1-0b9a-4348-b1e5-65a8c228372e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:09.394581 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5a1acfa1-0b9a-4348-b1e5-65a8c228372e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:09.411752 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a1acfa1-0b9a-4348-b1e5-65a8c228372e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:09.413087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a1acfa1-0b9a-4348-b1e5-65a8c228372e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:09.414230 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a1acfa1-0b9a-4348-b1e5-65a8c228372e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:09.416678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a1acfa1-0b9a-4348-b1e5-65a8c228372e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:09.701827 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5a1acfa1-0b9a-4348-b1e5-65a8c228372e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:09.718232 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5a1acfa1-0b9a-4348-b1e5-65a8c228372e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.330135 Jul 18 16:47:09.719072 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 86/160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:09 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:10.740025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-72e29288-c3c5-4728-8d89-7452d10c2a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:10.741248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-72e29288-c3c5-4728-8d89-7452d10c2a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:10.759481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72e29288-c3c5-4728-8d89-7452d10c2a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:10.766134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72e29288-c3c5-4728-8d89-7452d10c2a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:10.769204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72e29288-c3c5-4728-8d89-7452d10c2a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:10.770504 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72e29288-c3c5-4728-8d89-7452d10c2a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:10.814674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:11.201255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-72e29288-c3c5-4728-8d89-7452d10c2a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:11.201255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-72e29288-c3c5-4728-8d89-7452d10c2a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.463896 Jul 18 16:47:11.204101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 75/161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:10 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:12.214291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8fe296d0-7f20-4d86-8718-20e8431a5d11 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:12.215280 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8fe296d0-7f20-4d86-8718-20e8431a5d11 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:12.227996 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8fe296d0-7f20-4d86-8718-20e8431a5d11 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:12.227996 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8fe296d0-7f20-4d86-8718-20e8431a5d11 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:12.227996 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8fe296d0-7f20-4d86-8718-20e8431a5d11 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:12.229231 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8fe296d0-7f20-4d86-8718-20e8431a5d11 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:12.596564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8fe296d0-7f20-4d86-8718-20e8431a5d11 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:12.617381 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8fe296d0-7f20-4d86-8718-20e8431a5d11 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.397715 Jul 18 16:47:12.617381 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 87/162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:12 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:13.627035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2c00780a-9099-4310-8673-1b4f4627db23 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:13.629622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2c00780a-9099-4310-8673-1b4f4627db23 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:13.639966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2c00780a-9099-4310-8673-1b4f4627db23 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:13.640340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2c00780a-9099-4310-8673-1b4f4627db23 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:13.641128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2c00780a-9099-4310-8673-1b4f4627db23 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:13.641562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2c00780a-9099-4310-8673-1b4f4627db23 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:13.880099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2c00780a-9099-4310-8673-1b4f4627db23 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:13.902080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2c00780a-9099-4310-8673-1b4f4627db23 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.280008 Jul 18 16:47:13.903870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 76/163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:13 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:14.921633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3d598328-ab67-4544-a4c3-c7612de409f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:14.922241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3d598328-ab67-4544-a4c3-c7612de409f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:14.930428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d598328-ab67-4544-a4c3-c7612de409f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:14.930428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d598328-ab67-4544-a4c3-c7612de409f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:14.930428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d598328-ab67-4544-a4c3-c7612de409f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:14.930428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d598328-ab67-4544-a4c3-c7612de409f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:15.196944 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3d598328-ab67-4544-a4c3-c7612de409f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:15.206019 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3d598328-ab67-4544-a4c3-c7612de409f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.288549 Jul 18 16:47:15.206486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 88/164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:14 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:16.225251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-eff680f0-016e-4fd0-805c-6014aca25de9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:16.226611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-eff680f0-016e-4fd0-805c-6014aca25de9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:16.229444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:16.236337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eff680f0-016e-4fd0-805c-6014aca25de9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:16.237087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eff680f0-016e-4fd0-805c-6014aca25de9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:16.237880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eff680f0-016e-4fd0-805c-6014aca25de9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:16.238314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eff680f0-016e-4fd0-805c-6014aca25de9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:16.440862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-eff680f0-016e-4fd0-805c-6014aca25de9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:16.451451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-eff680f0-016e-4fd0-805c-6014aca25de9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.230343 Jul 18 16:47:16.452146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 77/165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:16 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:17.469006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a792fd38-0d06-4b17-9729-d118f965663d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:17.469718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a792fd38-0d06-4b17-9729-d118f965663d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:17.476667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a792fd38-0d06-4b17-9729-d118f965663d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:17.477122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a792fd38-0d06-4b17-9729-d118f965663d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:17.478545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a792fd38-0d06-4b17-9729-d118f965663d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:17.479364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a792fd38-0d06-4b17-9729-d118f965663d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:17.832136 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a792fd38-0d06-4b17-9729-d118f965663d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:17.841122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a792fd38-0d06-4b17-9729-d118f965663d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1521 microversion: 2.1 time: 0.375857 Jul 18 16:47:17.845787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 89/166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:17 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:18.859956 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a939820f-360a-4cd0-913a-9e412ea1271a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:18.862307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a939820f-360a-4cd0-913a-9e412ea1271a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:18.869302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a939820f-360a-4cd0-913a-9e412ea1271a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:18.869726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a939820f-360a-4cd0-913a-9e412ea1271a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:18.870503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a939820f-360a-4cd0-913a-9e412ea1271a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:18.870938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a939820f-360a-4cd0-913a-9e412ea1271a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:19.036795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a939820f-360a-4cd0-913a-9e412ea1271a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:19.036795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a939820f-360a-4cd0-913a-9e412ea1271a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1501 microversion: 2.1 time: 0.181255 Jul 18 16:47:19.036795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 78/167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:18 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:19.053476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d52c568e-c3b9-44d5-9000-4980a9b51ccf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:19.054082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d52c568e-c3b9-44d5-9000-4980a9b51ccf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:19.060988 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d52c568e-c3b9-44d5-9000-4980a9b51ccf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:19.061482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d52c568e-c3b9-44d5-9000-4980a9b51ccf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:19.062181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d52c568e-c3b9-44d5-9000-4980a9b51ccf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:19.062611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d52c568e-c3b9-44d5-9000-4980a9b51ccf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:19.240669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d52c568e-c3b9-44d5-9000-4980a9b51ccf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:19.248747 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d52c568e-c3b9-44d5-9000-4980a9b51ccf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1515 microversion: 2.1 time: 0.199466 Jul 18 16:47:19.249321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 90/168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:19 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:29.861145 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6868908e-7f9a-4a07-9035-89929e4a42ea tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:47:29.862168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6868908e-7f9a-4a07-9035-89929e4a42ea tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:29.864582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:29.865341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=21 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:29.870335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6868908e-7f9a-4a07-9035-89929e4a42ea tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:29.870792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6868908e-7f9a-4a07-9035-89929e4a42ea tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:29.871642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6868908e-7f9a-4a07-9035-89929e4a42ea tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:29.872082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6868908e-7f9a-4a07-9035-89929e4a42ea tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:29.896728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-6868908e-7f9a-4a07-9035-89929e4a42ea tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lazy-loading 'flavor' on Instance uuid ec9999e7-353f-4229-b587-c22a59c07d8b {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:47:30.410973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6868908e-7f9a-4a07-9035-89929e4a42ea tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "POST /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b/action" status: 200 len: 32 microversion: 2.1 time: 0.553616 Jul 18 16:47:30.411631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 79/169] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 16:47:29 2022] POST /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b/action => generated 32 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 16:47:30.420968 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d82ba378-52a3-4795-84e2-67a5e275d0f4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:30.421580 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d82ba378-52a3-4795-84e2-67a5e275d0f4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:30.424825 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=41 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:30.425474 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=51 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:30.429379 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d82ba378-52a3-4795-84e2-67a5e275d0f4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:30.429829 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d82ba378-52a3-4795-84e2-67a5e275d0f4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:30.430601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d82ba378-52a3-4795-84e2-67a5e275d0f4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:30.431041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d82ba378-52a3-4795-84e2-67a5e275d0f4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:30.593639 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d82ba378-52a3-4795-84e2-67a5e275d0f4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:30.603960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d82ba378-52a3-4795-84e2-67a5e275d0f4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.186035 Jul 18 16:47:30.604263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 91/170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:30 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:31.624085 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-850f6893-fe0d-4465-b45d-db9096ee211c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:31.624764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-850f6893-fe0d-4465-b45d-db9096ee211c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:31.632161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-850f6893-fe0d-4465-b45d-db9096ee211c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:31.632616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-850f6893-fe0d-4465-b45d-db9096ee211c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:31.634424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-850f6893-fe0d-4465-b45d-db9096ee211c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:31.634424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-850f6893-fe0d-4465-b45d-db9096ee211c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:31.783255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-850f6893-fe0d-4465-b45d-db9096ee211c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:31.792241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-850f6893-fe0d-4465-b45d-db9096ee211c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.173974 Jul 18 16:47:31.792825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 80/171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:31 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:32.821088 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c61ac09c-f208-4766-9c2b-fbd90d4784fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:32.822446 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c61ac09c-f208-4766-9c2b-fbd90d4784fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:32.848197 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c61ac09c-f208-4766-9c2b-fbd90d4784fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:32.848639 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c61ac09c-f208-4766-9c2b-fbd90d4784fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:32.853109 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c61ac09c-f208-4766-9c2b-fbd90d4784fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:32.855122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c61ac09c-f208-4766-9c2b-fbd90d4784fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:33.115776 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c61ac09c-f208-4766-9c2b-fbd90d4784fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:33.125474 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c61ac09c-f208-4766-9c2b-fbd90d4784fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.312749 Jul 18 16:47:33.126070 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 92/172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:32 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:34.143477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4d2c9b90-c5e7-4a48-8dab-3b1e080108ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:34.145847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4d2c9b90-c5e7-4a48-8dab-3b1e080108ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:34.151902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d2c9b90-c5e7-4a48-8dab-3b1e080108ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:34.152353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d2c9b90-c5e7-4a48-8dab-3b1e080108ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:34.153125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d2c9b90-c5e7-4a48-8dab-3b1e080108ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:34.153562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d2c9b90-c5e7-4a48-8dab-3b1e080108ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:34.301048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4d2c9b90-c5e7-4a48-8dab-3b1e080108ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:34.309320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4d2c9b90-c5e7-4a48-8dab-3b1e080108ba tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.169587 Jul 18 16:47:34.310221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 81/173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:34 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:35.326450 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f71ad24a-b9d0-44b3-94ba-dc53d67afc21 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:35.327058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f71ad24a-b9d0-44b3-94ba-dc53d67afc21 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:35.333119 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f71ad24a-b9d0-44b3-94ba-dc53d67afc21 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:35.333568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f71ad24a-b9d0-44b3-94ba-dc53d67afc21 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:35.334332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f71ad24a-b9d0-44b3-94ba-dc53d67afc21 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:35.334862 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f71ad24a-b9d0-44b3-94ba-dc53d67afc21 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:35.479712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f71ad24a-b9d0-44b3-94ba-dc53d67afc21 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:35.487338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f71ad24a-b9d0-44b3-94ba-dc53d67afc21 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.165020 Jul 18 16:47:35.487972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 93/174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:35 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:36.504198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ddf10de8-d990-41b5-a661-6892ba7ec8ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:36.504841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ddf10de8-d990-41b5-a661-6892ba7ec8ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:36.512148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ddf10de8-d990-41b5-a661-6892ba7ec8ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:36.512661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ddf10de8-d990-41b5-a661-6892ba7ec8ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:36.513475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ddf10de8-d990-41b5-a661-6892ba7ec8ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:36.513902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ddf10de8-d990-41b5-a661-6892ba7ec8ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:36.653589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ddf10de8-d990-41b5-a661-6892ba7ec8ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:36.661065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ddf10de8-d990-41b5-a661-6892ba7ec8ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.160697 Jul 18 16:47:36.661628 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 82/175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:36 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:37.678691 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-52fd1eaf-eb4f-4c98-bca4-ce80cac0848b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:37.679307 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-52fd1eaf-eb4f-4c98-bca4-ce80cac0848b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:37.685849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52fd1eaf-eb4f-4c98-bca4-ce80cac0848b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:37.686301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52fd1eaf-eb4f-4c98-bca4-ce80cac0848b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:37.687057 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52fd1eaf-eb4f-4c98-bca4-ce80cac0848b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:37.687542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52fd1eaf-eb4f-4c98-bca4-ce80cac0848b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:37.856302 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-52fd1eaf-eb4f-4c98-bca4-ce80cac0848b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:37.867034 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-52fd1eaf-eb4f-4c98-bca4-ce80cac0848b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.192160 Jul 18 16:47:37.867672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 94/176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:37 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:38.883195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d908a239-88d6-4879-ac9d-acf104f398e0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:38.883816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d908a239-88d6-4879-ac9d-acf104f398e0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:38.890478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d908a239-88d6-4879-ac9d-acf104f398e0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:38.890925 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d908a239-88d6-4879-ac9d-acf104f398e0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:38.891714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d908a239-88d6-4879-ac9d-acf104f398e0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:38.892144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d908a239-88d6-4879-ac9d-acf104f398e0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:39.039173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d908a239-88d6-4879-ac9d-acf104f398e0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:39.047206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d908a239-88d6-4879-ac9d-acf104f398e0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.167745 Jul 18 16:47:39.048318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 83/177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:38 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:40.066957 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a11272c7-7c05-4dda-8f64-ec13fd47965e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:40.067835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a11272c7-7c05-4dda-8f64-ec13fd47965e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:40.074923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a11272c7-7c05-4dda-8f64-ec13fd47965e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:40.075374 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a11272c7-7c05-4dda-8f64-ec13fd47965e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:40.076258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a11272c7-7c05-4dda-8f64-ec13fd47965e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:40.076699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a11272c7-7c05-4dda-8f64-ec13fd47965e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:40.218323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a11272c7-7c05-4dda-8f64-ec13fd47965e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:40.225814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a11272c7-7c05-4dda-8f64-ec13fd47965e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.164088 Jul 18 16:47:40.226395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 95/178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:40 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:41.245049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f735451c-6169-4b80-bde4-5f2ebece054d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:41.245697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f735451c-6169-4b80-bde4-5f2ebece054d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:41.252584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f735451c-6169-4b80-bde4-5f2ebece054d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:41.253263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f735451c-6169-4b80-bde4-5f2ebece054d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:41.254092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f735451c-6169-4b80-bde4-5f2ebece054d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:41.254523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f735451c-6169-4b80-bde4-5f2ebece054d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:41.393545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f735451c-6169-4b80-bde4-5f2ebece054d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:41.401640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f735451c-6169-4b80-bde4-5f2ebece054d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.161589 Jul 18 16:47:41.402225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 84/179] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:41 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:42.420142 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6962422a-d26e-48c0-b99b-db1dad9a3fda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:42.420676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6962422a-d26e-48c0-b99b-db1dad9a3fda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:42.426806 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6962422a-d26e-48c0-b99b-db1dad9a3fda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:42.431289 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6962422a-d26e-48c0-b99b-db1dad9a3fda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:42.431289 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6962422a-d26e-48c0-b99b-db1dad9a3fda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:42.431289 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6962422a-d26e-48c0-b99b-db1dad9a3fda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:42.568790 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6962422a-d26e-48c0-b99b-db1dad9a3fda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:42.585032 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6962422a-d26e-48c0-b99b-db1dad9a3fda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.169657 Jul 18 16:47:42.585609 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 96/180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:42 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:47:43.601496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0fd479f6-f9e3-4ffa-904a-8df671cdd5a6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:43.602105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0fd479f6-f9e3-4ffa-904a-8df671cdd5a6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:43.609301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0fd479f6-f9e3-4ffa-904a-8df671cdd5a6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:43.609772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0fd479f6-f9e3-4ffa-904a-8df671cdd5a6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:43.610517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0fd479f6-f9e3-4ffa-904a-8df671cdd5a6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:43.610954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0fd479f6-f9e3-4ffa-904a-8df671cdd5a6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:43.753281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0fd479f6-f9e3-4ffa-904a-8df671cdd5a6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:43.761457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0fd479f6-f9e3-4ffa-904a-8df671cdd5a6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.164371 Jul 18 16:47:43.762022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 85/181] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:43 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:44.791793 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7689e535-404b-44ef-80ac-e481464f3118 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:44.795410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7689e535-404b-44ef-80ac-e481464f3118 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:44.799506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7689e535-404b-44ef-80ac-e481464f3118 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:44.800165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7689e535-404b-44ef-80ac-e481464f3118 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:44.801214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7689e535-404b-44ef-80ac-e481464f3118 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:44.801937 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7689e535-404b-44ef-80ac-e481464f3118 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:44.950963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7689e535-404b-44ef-80ac-e481464f3118 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:44.959059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7689e535-404b-44ef-80ac-e481464f3118 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.171625 Jul 18 16:47:44.959679 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 97/182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:44 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:45.977974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7c514db9-ca94-44d2-86db-e4d159fc17b0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:45.978739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7c514db9-ca94-44d2-86db-e4d159fc17b0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:45.985881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7c514db9-ca94-44d2-86db-e4d159fc17b0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:45.986597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7c514db9-ca94-44d2-86db-e4d159fc17b0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:45.987378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7c514db9-ca94-44d2-86db-e4d159fc17b0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:45.987889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7c514db9-ca94-44d2-86db-e4d159fc17b0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:46.126529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7c514db9-ca94-44d2-86db-e4d159fc17b0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:46.134461 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7c514db9-ca94-44d2-86db-e4d159fc17b0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.160272 Jul 18 16:47:46.135639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 86/183] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:45 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:47.155771 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-612d7de3-1011-4d55-8a1e-e8e018b07f31 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:47.156482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-612d7de3-1011-4d55-8a1e-e8e018b07f31 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:47.164587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-612d7de3-1011-4d55-8a1e-e8e018b07f31 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:47.165101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-612d7de3-1011-4d55-8a1e-e8e018b07f31 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:47.169577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-612d7de3-1011-4d55-8a1e-e8e018b07f31 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:47.169577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-612d7de3-1011-4d55-8a1e-e8e018b07f31 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:47.314899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-612d7de3-1011-4d55-8a1e-e8e018b07f31 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:47.324353 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-612d7de3-1011-4d55-8a1e-e8e018b07f31 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.175214 Jul 18 16:47:47.325957 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 98/184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:47 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:48.342284 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2393935d-5360-49f6-90be-6cd3da06edc4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:48.342896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2393935d-5360-49f6-90be-6cd3da06edc4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:48.353843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2393935d-5360-49f6-90be-6cd3da06edc4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:48.354367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2393935d-5360-49f6-90be-6cd3da06edc4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:48.366745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2393935d-5360-49f6-90be-6cd3da06edc4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:48.367339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2393935d-5360-49f6-90be-6cd3da06edc4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:48.523115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2393935d-5360-49f6-90be-6cd3da06edc4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:48.533883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2393935d-5360-49f6-90be-6cd3da06edc4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.195243 Jul 18 16:47:48.534739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 87/185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:48 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:49.553542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1090d5ad-cd87-4e88-86b8-cbc96b8c6b19 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:49.554235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1090d5ad-cd87-4e88-86b8-cbc96b8c6b19 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:49.564355 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1090d5ad-cd87-4e88-86b8-cbc96b8c6b19 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:49.564355 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1090d5ad-cd87-4e88-86b8-cbc96b8c6b19 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:49.564355 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1090d5ad-cd87-4e88-86b8-cbc96b8c6b19 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:49.564355 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1090d5ad-cd87-4e88-86b8-cbc96b8c6b19 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:49.697673 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1090d5ad-cd87-4e88-86b8-cbc96b8c6b19 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:49.705627 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1090d5ad-cd87-4e88-86b8-cbc96b8c6b19 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.156040 Jul 18 16:47:49.706380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 99/186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:49 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:50.724466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0c3a08fb-3e7d-4d44-bd6d-76a9bded285c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:50.725092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0c3a08fb-3e7d-4d44-bd6d-76a9bded285c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:50.733007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c3a08fb-3e7d-4d44-bd6d-76a9bded285c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:50.733449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c3a08fb-3e7d-4d44-bd6d-76a9bded285c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:50.734210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c3a08fb-3e7d-4d44-bd6d-76a9bded285c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:50.736460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c3a08fb-3e7d-4d44-bd6d-76a9bded285c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:51.019877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0c3a08fb-3e7d-4d44-bd6d-76a9bded285c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:51.027536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0c3a08fb-3e7d-4d44-bd6d-76a9bded285c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.307861 Jul 18 16:47:51.028684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 88/187] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:50 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:52.046067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d1996034-a333-4d5a-b33c-42a0b980a647 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:52.046754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d1996034-a333-4d5a-b33c-42a0b980a647 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:52.053843 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1996034-a333-4d5a-b33c-42a0b980a647 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:52.054282 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1996034-a333-4d5a-b33c-42a0b980a647 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:52.055030 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1996034-a333-4d5a-b33c-42a0b980a647 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:52.055575 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1996034-a333-4d5a-b33c-42a0b980a647 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:52.202247 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d1996034-a333-4d5a-b33c-42a0b980a647 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:52.210379 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d1996034-a333-4d5a-b33c-42a0b980a647 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.168022 Jul 18 16:47:52.210935 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 100/188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:52 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:52.407992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-60e63944-3708-4648-9d1e-2279598582e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:52.408524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-60e63944-3708-4648-9d1e-2279598582e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:52.415148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-60e63944-3708-4648-9d1e-2279598582e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:52.415642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-60e63944-3708-4648-9d1e-2279598582e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:52.416997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-60e63944-3708-4648-9d1e-2279598582e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:52.417441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-60e63944-3708-4648-9d1e-2279598582e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:52.443620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-60e63944-3708-4648-9d1e-2279598582e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/ips" status: 200 len: 147 microversion: 2.1 time: 0.039329 Jul 18 16:47:52.444265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 89/189] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 16:47:52 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:53.229922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1ffcc6e2-4928-49f4-bf28-67161e5b50b3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:53.231096 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1ffcc6e2-4928-49f4-bf28-67161e5b50b3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:53.237211 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1ffcc6e2-4928-49f4-bf28-67161e5b50b3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:53.241933 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1ffcc6e2-4928-49f4-bf28-67161e5b50b3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:53.241933 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1ffcc6e2-4928-49f4-bf28-67161e5b50b3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:53.241933 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1ffcc6e2-4928-49f4-bf28-67161e5b50b3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:53.378638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1ffcc6e2-4928-49f4-bf28-67161e5b50b3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:53.391619 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1ffcc6e2-4928-49f4-bf28-67161e5b50b3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.165770 Jul 18 16:47:53.392450 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 101/190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:53 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:54.409575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-51be1135-c05a-4d95-8fa6-4fdad0ee0e15 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:54.410816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-51be1135-c05a-4d95-8fa6-4fdad0ee0e15 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:54.417320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-51be1135-c05a-4d95-8fa6-4fdad0ee0e15 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:54.417761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-51be1135-c05a-4d95-8fa6-4fdad0ee0e15 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:54.418513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-51be1135-c05a-4d95-8fa6-4fdad0ee0e15 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:54.418986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-51be1135-c05a-4d95-8fa6-4fdad0ee0e15 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:54.560361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-51be1135-c05a-4d95-8fa6-4fdad0ee0e15 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:54.568195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-51be1135-c05a-4d95-8fa6-4fdad0ee0e15 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.162426 Jul 18 16:47:54.568773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 90/191] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:54 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:55.302683 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1667293297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-305916691", "security_groups": [{"name": "tempest-secgroup-smoke-754290991"}], "networks": [{"uuid": "a8453554-6edf-46ad-bde2-ec30affcf6aa"}], "block_device_mapping_v2": [{"uuid": "ae324925-493a-4d18-990a-fd5d6b0e231f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:47:55.420590 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.network.neutron [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] validate_networks() for [('a8453554-6edf-46ad-bde2-ec30affcf6aa', None, None, None, None, None)] {{(pid=124945) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:47:55.587281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-17cc9dbf-a148-4b86-891f-89da1f11a8ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:55.589263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-17cc9dbf-a148-4b86-891f-89da1f11a8ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:55.595936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17cc9dbf-a148-4b86-891f-89da1f11a8ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:55.596470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17cc9dbf-a148-4b86-891f-89da1f11a8ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:55.597244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17cc9dbf-a148-4b86-891f-89da1f11a8ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:55.597715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17cc9dbf-a148-4b86-891f-89da1f11a8ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:55.750801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-17cc9dbf-a148-4b86-891f-89da1f11a8ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:55.758544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-17cc9dbf-a148-4b86-891f-89da1f11a8ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.176044 Jul 18 16:47:55.759230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 91/192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:55 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:47:55.824081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Flavor limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:47:55.824492 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Image limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:47:55.824952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Flavor pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:47:55.825350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Image pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:47:55.826036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:47:55.835172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:55.835873 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:55.836806 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:55.837378 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:55.856952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Getting quotas for project 5d70fe1437fc423681962ee747f07410. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:47:55.860972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Getting quotas for user 6472100830a54d6a8e21ee55b68e6a02 and project 5d70fe1437fc423681962ee747f07410. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:47:55.920161 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Going to run 1 instances... {{(pid=124945) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:47:55.922225 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae324925-493a-4d18-990a-fd5d6b0e231f',volume_size=None,volume_type=None)] {{(pid=124945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:47:56.625213 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e5db99fb-80e6-458e-9c10-4d91157d72d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.326281 Jul 18 16:47:56.625905 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 102/193] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 16:47:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:47:56.636567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-06e45093-01b9-4da8-8d7e-d33f29e4821a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:56.637184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-06e45093-01b9-4da8-8d7e-d33f29e4821a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:56.717084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-06e45093-01b9-4da8-8d7e-d33f29e4821a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:56.723737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-06e45093-01b9-4da8-8d7e-d33f29e4821a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1088 microversion: 2.1 time: 0.091400 Jul 18 16:47:56.724299 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 92/194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:56 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1088 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:56.780542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3a0bf11b-65c3-4afd-be54-1c10c12a6572 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:56.781686 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3a0bf11b-65c3-4afd-be54-1c10c12a6572 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:56.792870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a0bf11b-65c3-4afd-be54-1c10c12a6572 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:56.793325 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a0bf11b-65c3-4afd-be54-1c10c12a6572 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:56.794455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a0bf11b-65c3-4afd-be54-1c10c12a6572 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:56.795688 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a0bf11b-65c3-4afd-be54-1c10c12a6572 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:56.951285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3a0bf11b-65c3-4afd-be54-1c10c12a6572 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:56.957052 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3a0bf11b-65c3-4afd-be54-1c10c12a6572 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.184104 Jul 18 16:47:56.957800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 103/195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:56 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:57.741250 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-02745c70-aeb7-4779-8d42-7ccd029f8c01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:57.741860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-02745c70-aeb7-4779-8d42-7ccd029f8c01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:57.815398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-02745c70-aeb7-4779-8d42-7ccd029f8c01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:57.823519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-02745c70-aeb7-4779-8d42-7ccd029f8c01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1088 microversion: 2.1 time: 0.085801 Jul 18 16:47:57.824314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 93/196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:57 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:57.977235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4e45eee8-1dd5-48eb-8b3f-5d95e16154b4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:57.977846 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4e45eee8-1dd5-48eb-8b3f-5d95e16154b4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:57.987731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4e45eee8-1dd5-48eb-8b3f-5d95e16154b4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:57.988718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4e45eee8-1dd5-48eb-8b3f-5d95e16154b4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:57.990021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4e45eee8-1dd5-48eb-8b3f-5d95e16154b4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:57.990977 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4e45eee8-1dd5-48eb-8b3f-5d95e16154b4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:58.179326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4e45eee8-1dd5-48eb-8b3f-5d95e16154b4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:58.186916 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4e45eee8-1dd5-48eb-8b3f-5d95e16154b4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.215200 Jul 18 16:47:58.187477 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 104/197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:57 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:47:58.387135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4368218f-d99a-403e-aff5-ad9d20e754e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb7aa4fe-c42e-47b4-bad6-add28b0d5f8c"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:47:58.388416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4368218f-d99a-403e-aff5-ad9d20e754e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:58.395800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4368218f-d99a-403e-aff5-ad9d20e754e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:58.396254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4368218f-d99a-403e-aff5-ad9d20e754e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:58.399068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4368218f-d99a-403e-aff5-ad9d20e754e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:58.399588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4368218f-d99a-403e-aff5-ad9d20e754e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:58.841192 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a2191757-fda7-42ed-b68f-ba97c5fc224c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:58.841972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a2191757-fda7-42ed-b68f-ba97c5fc224c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:58.849149 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a2191757-fda7-42ed-b68f-ba97c5fc224c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:58.849596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a2191757-fda7-42ed-b68f-ba97c5fc224c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:58.850365 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a2191757-fda7-42ed-b68f-ba97c5fc224c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:58.850969 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a2191757-fda7-42ed-b68f-ba97c5fc224c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:58.925540 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a2191757-fda7-42ed-b68f-ba97c5fc224c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:58.934912 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a2191757-fda7-42ed-b68f-ba97c5fc224c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1186 microversion: 2.1 time: 0.097521 Jul 18 16:47:58.946279 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 105/198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:58 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1186 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:47:59.101146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:59.204688 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-939f32e6-1c8a-4321-bdf4-f6fac3623783 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:59.205301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-939f32e6-1c8a-4321-bdf4-f6fac3623783 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:59.218418 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-939f32e6-1c8a-4321-bdf4-f6fac3623783 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:59.219244 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-939f32e6-1c8a-4321-bdf4-f6fac3623783 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:59.220263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-939f32e6-1c8a-4321-bdf4-f6fac3623783 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:59.220877 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-939f32e6-1c8a-4321-bdf4-f6fac3623783 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:59.288805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4368218f-d99a-403e-aff5-ad9d20e754e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902515 Jul 18 16:47:59.288805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 94/199] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 16:47:58 2022] POST /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:47:59.522203 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-939f32e6-1c8a-4321-bdf4-f6fac3623783 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:47:59.532550 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-939f32e6-1c8a-4321-bdf4-f6fac3623783 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.332531 Jul 18 16:47:59.533258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 106/200] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:59 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:47:59.953880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-77d71a3a-f037-40d8-a4a9-c495b0434048 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:47:59.954827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-77d71a3a-f037-40d8-a4a9-c495b0434048 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:47:59.966466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77d71a3a-f037-40d8-a4a9-c495b0434048 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:59.966910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77d71a3a-f037-40d8-a4a9-c495b0434048 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:47:59.967708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77d71a3a-f037-40d8-a4a9-c495b0434048 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:47:59.968140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77d71a3a-f037-40d8-a4a9-c495b0434048 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:00.041589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-77d71a3a-f037-40d8-a4a9-c495b0434048 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:00.049535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-77d71a3a-f037-40d8-a4a9-c495b0434048 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1204 microversion: 2.1 time: 0.100748 Jul 18 16:48:00.065506 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 95/201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:47:59 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1204 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:00.551424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-702bf5a2-1906-49c8-a2aa-6eea00d89c7b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:00.552872 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-702bf5a2-1906-49c8-a2aa-6eea00d89c7b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:00.561654 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-702bf5a2-1906-49c8-a2aa-6eea00d89c7b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:00.562331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-702bf5a2-1906-49c8-a2aa-6eea00d89c7b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:00.563255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-702bf5a2-1906-49c8-a2aa-6eea00d89c7b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:00.563924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-702bf5a2-1906-49c8-a2aa-6eea00d89c7b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:00.788174 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-702bf5a2-1906-49c8-a2aa-6eea00d89c7b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:00.796838 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-702bf5a2-1906-49c8-a2aa-6eea00d89c7b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.250031 Jul 18 16:48:00.797775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 107/202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:00 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:01.071996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8055d53c-c7aa-4bc4-97ed-0c86d27805c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:01.078800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8055d53c-c7aa-4bc4-97ed-0c86d27805c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:01.090814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8055d53c-c7aa-4bc4-97ed-0c86d27805c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:01.092718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8055d53c-c7aa-4bc4-97ed-0c86d27805c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:01.094204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8055d53c-c7aa-4bc4-97ed-0c86d27805c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:01.094878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8055d53c-c7aa-4bc4-97ed-0c86d27805c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:01.356123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8055d53c-c7aa-4bc4-97ed-0c86d27805c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:01.364392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8055d53c-c7aa-4bc4-97ed-0c86d27805c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.301186 Jul 18 16:48:01.366164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 96/203] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:01 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:01.816149 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ab95d8f2-424b-41dd-8606-134c5eab8756 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:01.816750 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ab95d8f2-424b-41dd-8606-134c5eab8756 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:01.824798 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab95d8f2-424b-41dd-8606-134c5eab8756 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:01.826425 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab95d8f2-424b-41dd-8606-134c5eab8756 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:01.827668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab95d8f2-424b-41dd-8606-134c5eab8756 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:01.828605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab95d8f2-424b-41dd-8606-134c5eab8756 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:01.863767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:02.044869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-f7fd512e-222c-4038-bee8-315cf6d62861 req-f3056795-bad0-4ad3-916f-a28cf4ed1e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1c9245-f7e5-4ff8-b561-7dc29e139931", "tag": "58e840d1-84ce-4ac8-bb93-2ee5a430d89d"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:02.052030 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ab95d8f2-424b-41dd-8606-134c5eab8756 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:02.063409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f7fd512e-222c-4038-bee8-315cf6d62861 req-f3056795-bad0-4ad3-916f-a28cf4ed1e6e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:02.063409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f7fd512e-222c-4038-bee8-315cf6d62861 req-f3056795-bad0-4ad3-916f-a28cf4ed1e6e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:02.063946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ab95d8f2-424b-41dd-8606-134c5eab8756 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.250548 Jul 18 16:48:02.063946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 108/204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:01 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:02.078534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-f7fd512e-222c-4038-bee8-315cf6d62861 req-f3056795-bad0-4ad3-916f-a28cf4ed1e6e service nova] Creating event network-changed:58e840d1-84ce-4ac8-bb93-2ee5a430d89d for instance 6f1c9245-f7e5-4ff8-b561-7dc29e139931 on hv-cinder-84617 Jul 18 16:48:02.090973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-f7fd512e-222c-4038-bee8-315cf6d62861 req-f3056795-bad0-4ad3-916f-a28cf4ed1e6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060352 Jul 18 16:48:02.092366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 97/205] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:48:02.381171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c9f1e0f7-d7ee-4c67-a483-f5b0c0083198 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:02.381839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c9f1e0f7-d7ee-4c67-a483-f5b0c0083198 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:02.389133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c9f1e0f7-d7ee-4c67-a483-f5b0c0083198 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:02.389582 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c9f1e0f7-d7ee-4c67-a483-f5b0c0083198 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:02.390363 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c9f1e0f7-d7ee-4c67-a483-f5b0c0083198 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:02.390813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c9f1e0f7-d7ee-4c67-a483-f5b0c0083198 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:02.627326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c9f1e0f7-d7ee-4c67-a483-f5b0c0083198 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:02.635652 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c9f1e0f7-d7ee-4c67-a483-f5b0c0083198 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.257816 Jul 18 16:48:02.636437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 109/206] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:02 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:03.079774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7d990058-5d37-4a8a-90b1-fce082d04fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:03.080579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7d990058-5d37-4a8a-90b1-fce082d04fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:03.087556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d990058-5d37-4a8a-90b1-fce082d04fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:03.093403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d990058-5d37-4a8a-90b1-fce082d04fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:03.093403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d990058-5d37-4a8a-90b1-fce082d04fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:03.093403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d990058-5d37-4a8a-90b1-fce082d04fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:03.253577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7d990058-5d37-4a8a-90b1-fce082d04fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:03.261953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7d990058-5d37-4a8a-90b1-fce082d04fa6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.186800 Jul 18 16:48:03.262575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 98/207] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:03 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:03.654445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-fb6a02c9-8618-4c90-b44b-a6cd3c8d02f4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:03.655063 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-fb6a02c9-8618-4c90-b44b-a6cd3c8d02f4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:03.657103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:03.662041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb6a02c9-8618-4c90-b44b-a6cd3c8d02f4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:03.662682 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb6a02c9-8618-4c90-b44b-a6cd3c8d02f4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:03.663391 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb6a02c9-8618-4c90-b44b-a6cd3c8d02f4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:03.663940 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb6a02c9-8618-4c90-b44b-a6cd3c8d02f4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:03.801573 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-fb6a02c9-8618-4c90-b44b-a6cd3c8d02f4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:03.815752 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-fb6a02c9-8618-4c90-b44b-a6cd3c8d02f4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.166510 Jul 18 16:48:03.825522 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 110/208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:03 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:04.278703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8f132eab-8745-4c90-bfd2-38b92bea0a5c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:04.279315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8f132eab-8745-4c90-bfd2-38b92bea0a5c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:04.281767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=45 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:04.290411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8f132eab-8745-4c90-bfd2-38b92bea0a5c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.291103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8f132eab-8745-4c90-bfd2-38b92bea0a5c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:04.292518 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8f132eab-8745-4c90-bfd2-38b92bea0a5c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.293074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8f132eab-8745-4c90-bfd2-38b92bea0a5c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:04.466605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8f132eab-8745-4c90-bfd2-38b92bea0a5c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:04.475679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8f132eab-8745-4c90-bfd2-38b92bea0a5c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1501 microversion: 2.1 time: 0.201346 Jul 18 16:48:04.476449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 99/209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:04 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1501 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:04.503306 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec271b07-c45a-4651-ac3c-d477a5f05890"}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:04.503306 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:04.508104 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.508837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:04.509609 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.510085 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:04.542476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] HTTP exception thrown: Cannot 'attach_volume' instance ec9999e7-353f-4229-b587-c22a59c07d8b while it is in vm_state rescued Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Request method failure captured: Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: POST /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b/os-volume_attachments HTTP/1.1 Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 74 Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y5MWhmLR6v2w8S-LyWxPRgcC34RixV-8cPDNn9dS_bGgBpF8MjoYmHjFPtIDP8cJ9F8OQSL62PlItKTud-7cmiLxFty2i1PV0Vj7ts6m1No8Ts6r7-Ph7maB_FZFLrcOxY4WRg3E-sMjSxiADEblsLG4xB40GTnS4pkme3v840UBCo Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 69c48eddc2334918970e61725bedafd1 Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523664587 Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:48:04.544132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/69c48eddc2334918970e61725bedafd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_69c48eddc2334918970e61725bedafd1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/69c48eddc2334918970e61725bedafd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/69c48eddc2334918970e61725bedafd1"}]}] Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523664587 Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 69c48eddc2334918970e61725bedafd1 Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523664587 Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-ServerRescueNegativeTestJSON-1523664587-project Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: 642ba7eed36e4956834c06b771259a42 Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523664587-project Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {"volumeAttachment": {"volumeId": "ec271b07-c45a-4651-ac3c-d477a5f05890"}} Jul 18 16:48:04.545986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: > Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Cannot 'attach_volume' instance ec9999e7-353f-4229-b587-c22a59c07d8b while it is in vm_state rescued Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'server_id': 'ec9999e7-353f-4229-b587-c22a59c07d8b', 'body': {'volumeAttachment': {'volumeId': 'ec271b07-c45a-4651-ac3c-d477a5f05890'}}} Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec9999e7-353f-4229-b587-c22a59c07d8b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:48:04.546687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ec9999e7-353f-4229-b587-c22a59c07d8b while it is in vm_state rescued Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:48:04.551103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:48:04.552219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:48:04.552219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:48:04.552219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ec9999e7-353f-4229-b587-c22a59c07d8b while it is in vm_state rescued Jul 18 16:48:04.552219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:04.552219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Returning 409 to user: Cannot 'attach_volume' instance ec9999e7-353f-4229-b587-c22a59c07d8b while it is in vm_state rescued {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:48:04.552219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ac8064c7-c306-4d5c-8bac-8989298c9272 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "POST /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054056 Jul 18 16:48:04.552219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 111/210] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 16:48:04 2022] POST /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 16:48:04.559763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-83b03299-3340-44da-9c15-0fe877fa9db1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:04.560381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-83b03299-3340-44da-9c15-0fe877fa9db1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:04.566669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83b03299-3340-44da-9c15-0fe877fa9db1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.567214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83b03299-3340-44da-9c15-0fe877fa9db1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:04.568092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83b03299-3340-44da-9c15-0fe877fa9db1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.568617 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83b03299-3340-44da-9c15-0fe877fa9db1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:04.848968 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d1effdb2-a3bf-4e0a-a313-c9ebc70b7981 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:04.856442 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d1effdb2-a3bf-4e0a-a313-c9ebc70b7981 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:04.865265 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1effdb2-a3bf-4e0a-a313-c9ebc70b7981 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.865771 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1effdb2-a3bf-4e0a-a313-c9ebc70b7981 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:04.866532 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1effdb2-a3bf-4e0a-a313-c9ebc70b7981 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.866998 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1effdb2-a3bf-4e0a-a313-c9ebc70b7981 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:04.932397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-83b03299-3340-44da-9c15-0fe877fa9db1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "POST /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b/action" status: 202 len: 0 microversion: 2.1 time: 0.376528 Jul 18 16:48:04.932928 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 100/211] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 16:48:04 2022] POST /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 16:48:04.941382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c6e7cf25-005c-4b9d-91d3-2a4f8ed54450 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:04.942082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c6e7cf25-005c-4b9d-91d3-2a4f8ed54450 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:04.950392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c6e7cf25-005c-4b9d-91d3-2a4f8ed54450 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.951386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c6e7cf25-005c-4b9d-91d3-2a4f8ed54450 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:04.952420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c6e7cf25-005c-4b9d-91d3-2a4f8ed54450 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:04.952895 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c6e7cf25-005c-4b9d-91d3-2a4f8ed54450 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:05.038529 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d1effdb2-a3bf-4e0a-a313-c9ebc70b7981 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:05.047983 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d1effdb2-a3bf-4e0a-a313-c9ebc70b7981 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.217672 Jul 18 16:48:05.048837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 112/212] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:04 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:05.164418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c6e7cf25-005c-4b9d-91d3-2a4f8ed54450 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:05.179636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c6e7cf25-005c-4b9d-91d3-2a4f8ed54450 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.241983 Jul 18 16:48:05.180691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 101/213] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:04 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:06.065094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cc4131d3-ce07-4c34-bebf-fa6722cba698 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:06.065896 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cc4131d3-ce07-4c34-bebf-fa6722cba698 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:06.068199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=2 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:06.069240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=6 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:06.077062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc4131d3-ce07-4c34-bebf-fa6722cba698 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:06.077591 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc4131d3-ce07-4c34-bebf-fa6722cba698 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:06.078429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc4131d3-ce07-4c34-bebf-fa6722cba698 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:06.078894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc4131d3-ce07-4c34-bebf-fa6722cba698 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:06.207664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-166033b2-240a-4f29-b9fa-8ab880db6c0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:06.208913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-166033b2-240a-4f29-b9fa-8ab880db6c0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:06.216784 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-166033b2-240a-4f29-b9fa-8ab880db6c0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:06.217226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-166033b2-240a-4f29-b9fa-8ab880db6c0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:06.218007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-166033b2-240a-4f29-b9fa-8ab880db6c0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:06.218564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-166033b2-240a-4f29-b9fa-8ab880db6c0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:06.248752 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cc4131d3-ce07-4c34-bebf-fa6722cba698 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:06.256711 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cc4131d3-ce07-4c34-bebf-fa6722cba698 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.195585 Jul 18 16:48:06.257537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 113/214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:06 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:06.428734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-166033b2-240a-4f29-b9fa-8ab880db6c0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:06.438958 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-166033b2-240a-4f29-b9fa-8ab880db6c0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.235598 Jul 18 16:48:06.440123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 102/215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:06 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:07.278700 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-249341b9-53dd-41c6-b80d-5c6d26f3b2bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:07.279947 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-249341b9-53dd-41c6-b80d-5c6d26f3b2bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:07.285962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-249341b9-53dd-41c6-b80d-5c6d26f3b2bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:07.286402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-249341b9-53dd-41c6-b80d-5c6d26f3b2bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:07.287153 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-249341b9-53dd-41c6-b80d-5c6d26f3b2bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:07.287745 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-249341b9-53dd-41c6-b80d-5c6d26f3b2bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:07.436304 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-249341b9-53dd-41c6-b80d-5c6d26f3b2bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:07.446069 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-249341b9-53dd-41c6-b80d-5c6d26f3b2bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.173805 Jul 18 16:48:07.446663 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 114/216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:07.457806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ec8b6db6-238c-481b-8c83-693c579ae676 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:07.458441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ec8b6db6-238c-481b-8c83-693c579ae676 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:07.466557 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec8b6db6-238c-481b-8c83-693c579ae676 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:07.467011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec8b6db6-238c-481b-8c83-693c579ae676 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:07.467820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec8b6db6-238c-481b-8c83-693c579ae676 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:07.468353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec8b6db6-238c-481b-8c83-693c579ae676 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:07.606574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ec8b6db6-238c-481b-8c83-693c579ae676 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:07.615400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ec8b6db6-238c-481b-8c83-693c579ae676 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.161824 Jul 18 16:48:07.616113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 103/217] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:07 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:08.464353 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-664e09d5-7351-4481-a41d-8e03fe9c9d44 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:08.464952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-664e09d5-7351-4481-a41d-8e03fe9c9d44 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:08.471216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-664e09d5-7351-4481-a41d-8e03fe9c9d44 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:08.471707 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-664e09d5-7351-4481-a41d-8e03fe9c9d44 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:08.472464 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-664e09d5-7351-4481-a41d-8e03fe9c9d44 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:08.472949 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-664e09d5-7351-4481-a41d-8e03fe9c9d44 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:08.638899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9c69754b-938e-43e8-8863-ac8195340552 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:08.639989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9c69754b-938e-43e8-8863-ac8195340552 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:08.645182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:08.650338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c69754b-938e-43e8-8863-ac8195340552 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:08.651798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c69754b-938e-43e8-8863-ac8195340552 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:08.652770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c69754b-938e-43e8-8863-ac8195340552 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:08.653428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c69754b-938e-43e8-8863-ac8195340552 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:08.714249 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-664e09d5-7351-4481-a41d-8e03fe9c9d44 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:08.722727 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-664e09d5-7351-4481-a41d-8e03fe9c9d44 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.262519 Jul 18 16:48:08.723310 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 115/218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:08 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:08.877889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9c69754b-938e-43e8-8863-ac8195340552 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:08.888326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9c69754b-938e-43e8-8863-ac8195340552 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.257863 Jul 18 16:48:08.895582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 104/219] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:08 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:09.741045 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3253676a-dee6-462c-b87a-310e80c9c6f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:09.744599 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3253676a-dee6-462c-b87a-310e80c9c6f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:09.750351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3253676a-dee6-462c-b87a-310e80c9c6f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:09.750800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3253676a-dee6-462c-b87a-310e80c9c6f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:09.751614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3253676a-dee6-462c-b87a-310e80c9c6f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:09.752051 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3253676a-dee6-462c-b87a-310e80c9c6f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:09.908945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-afcc79e6-2512-4d66-a753-c16e0c2d3b7a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:09.910580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-afcc79e6-2512-4d66-a753-c16e0c2d3b7a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:09.929040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afcc79e6-2512-4d66-a753-c16e0c2d3b7a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:09.929890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afcc79e6-2512-4d66-a753-c16e0c2d3b7a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:09.930752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afcc79e6-2512-4d66-a753-c16e0c2d3b7a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:09.931475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afcc79e6-2512-4d66-a753-c16e0c2d3b7a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:09.943935 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3253676a-dee6-462c-b87a-310e80c9c6f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:09.954437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3253676a-dee6-462c-b87a-310e80c9c6f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.217886 Jul 18 16:48:09.967528 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 116/220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:09 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:10.140950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-afcc79e6-2512-4d66-a753-c16e0c2d3b7a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:10.153354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-afcc79e6-2512-4d66-a753-c16e0c2d3b7a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.250267 Jul 18 16:48:10.154467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 105/221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:09 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:10.973756 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0be46b18-dcad-45d6-a8c0-d8b9552ef7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:10.981814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0be46b18-dcad-45d6-a8c0-d8b9552ef7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:10.981814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0be46b18-dcad-45d6-a8c0-d8b9552ef7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:10.981814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0be46b18-dcad-45d6-a8c0-d8b9552ef7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:10.982371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0be46b18-dcad-45d6-a8c0-d8b9552ef7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:10.982809 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0be46b18-dcad-45d6-a8c0-d8b9552ef7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:11.151790 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0be46b18-dcad-45d6-a8c0-d8b9552ef7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:11.163312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0be46b18-dcad-45d6-a8c0-d8b9552ef7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.190943 Jul 18 16:48:11.163312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 117/222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:10 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:11.171187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c80cbeb0-403b-41f1-844f-a69f3e2256d9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:11.172520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c80cbeb0-403b-41f1-844f-a69f3e2256d9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:11.178321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c80cbeb0-403b-41f1-844f-a69f3e2256d9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:11.178854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c80cbeb0-403b-41f1-844f-a69f3e2256d9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:11.179719 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c80cbeb0-403b-41f1-844f-a69f3e2256d9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:11.180357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c80cbeb0-403b-41f1-844f-a69f3e2256d9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:11.323115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c80cbeb0-403b-41f1-844f-a69f3e2256d9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:11.332338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c80cbeb0-403b-41f1-844f-a69f3e2256d9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.165478 Jul 18 16:48:11.333107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 106/223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:11 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:12.178850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cf9a263d-86de-41c0-a398-07d3b8af4e91 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:12.179439 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cf9a263d-86de-41c0-a398-07d3b8af4e91 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:12.188332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf9a263d-86de-41c0-a398-07d3b8af4e91 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:12.188852 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf9a263d-86de-41c0-a398-07d3b8af4e91 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:12.189606 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf9a263d-86de-41c0-a398-07d3b8af4e91 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:12.189909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf9a263d-86de-41c0-a398-07d3b8af4e91 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:12.335982 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cf9a263d-86de-41c0-a398-07d3b8af4e91 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:12.345375 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cf9a263d-86de-41c0-a398-07d3b8af4e91 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.170124 Jul 18 16:48:12.346817 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 118/224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:12 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:12.362514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-09a301d2-8851-423f-b22b-4d87647506a8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:12.363513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-09a301d2-8851-423f-b22b-4d87647506a8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:12.381098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09a301d2-8851-423f-b22b-4d87647506a8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:12.381581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09a301d2-8851-423f-b22b-4d87647506a8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:12.382358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09a301d2-8851-423f-b22b-4d87647506a8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:12.382921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09a301d2-8851-423f-b22b-4d87647506a8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:12.528827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-09a301d2-8851-423f-b22b-4d87647506a8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:12.536475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-09a301d2-8851-423f-b22b-4d87647506a8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.185054 Jul 18 16:48:12.538361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 107/225] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:12 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:13.366134 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1395fdf3-c674-41f4-86d6-cd86058edad1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:13.366746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1395fdf3-c674-41f4-86d6-cd86058edad1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:13.373942 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1395fdf3-c674-41f4-86d6-cd86058edad1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:13.374387 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1395fdf3-c674-41f4-86d6-cd86058edad1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:13.375150 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1395fdf3-c674-41f4-86d6-cd86058edad1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:13.375617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1395fdf3-c674-41f4-86d6-cd86058edad1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:13.554980 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-36ad056d-f3e2-44d0-bd31-e9f52de0087f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:13.556101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-36ad056d-f3e2-44d0-bd31-e9f52de0087f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:13.560255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1395fdf3-c674-41f4-86d6-cd86058edad1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:13.563724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36ad056d-f3e2-44d0-bd31-e9f52de0087f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:13.568982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36ad056d-f3e2-44d0-bd31-e9f52de0087f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:13.568982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36ad056d-f3e2-44d0-bd31-e9f52de0087f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:13.568982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36ad056d-f3e2-44d0-bd31-e9f52de0087f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:13.569370 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1395fdf3-c674-41f4-86d6-cd86058edad1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.205683 Jul 18 16:48:13.569370 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 119/226] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:13 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:13.706549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-36ad056d-f3e2-44d0-bd31-e9f52de0087f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:13.714950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-36ad056d-f3e2-44d0-bd31-e9f52de0087f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.163811 Jul 18 16:48:13.715547 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 108/227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:13 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:14.553613 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1016949176", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "networks": [{"uuid": "da465a9c-ad0b-4855-80f9-49cabf0f047d"}]}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:14.585745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-50c72247-acda-41de-9d41-c007e3e44fbd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:14.586354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-50c72247-acda-41de-9d41-c007e3e44fbd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:14.593215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50c72247-acda-41de-9d41-c007e3e44fbd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:14.594286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50c72247-acda-41de-9d41-c007e3e44fbd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:14.594731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50c72247-acda-41de-9d41-c007e3e44fbd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:14.595174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50c72247-acda-41de-9d41-c007e3e44fbd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:14.617136 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.network.neutron [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] validate_networks() for [('da465a9c-ad0b-4855-80f9-49cabf0f047d', None, None, None, None, None)] {{(pid=124945) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:48:14.768046 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-50c72247-acda-41de-9d41-c007e3e44fbd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:14.774605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-50c72247-acda-41de-9d41-c007e3e44fbd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.192786 Jul 18 16:48:14.775368 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 109/228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:14 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:14.780117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-434f453d-b960-4f12-8df0-c2f48b1f8d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:14.780893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-434f453d-b960-4f12-8df0-c2f48b1f8d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:14.787072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-434f453d-b960-4f12-8df0-c2f48b1f8d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:14.787548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-434f453d-b960-4f12-8df0-c2f48b1f8d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:14.788521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-434f453d-b960-4f12-8df0-c2f48b1f8d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:14.788950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-434f453d-b960-4f12-8df0-c2f48b1f8d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:14.940681 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-434f453d-b960-4f12-8df0-c2f48b1f8d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:14.944499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:14.949660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-434f453d-b960-4f12-8df0-c2f48b1f8d26 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.173316 Jul 18 16:48:14.950455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 110/229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:14 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:15.052910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Flavor limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:48:15.053331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Image limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:48:15.053801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Flavor pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:48:15.054314 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Image pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:48:15.054746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:48:15.067251 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:15.068041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:15.069365 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:15.070068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:15.089980 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Getting quotas for project b2153f74cf4b4bdcb0aab5b6921ca3ad. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:48:15.093886 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Getting quotas for user e548ea934bc14b7e921f7e161c5496cf and project b2153f74cf4b4bdcb0aab5b6921ca3ad. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:48:15.107311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Going to run 1 instances... {{(pid=124945) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:48:15.109542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:48:15.216557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-08659b63-3d7d-47af-ad55-b21ff55669c7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666837 Jul 18 16:48:15.217220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 120/230] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 16:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:48:15.228650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-40358502-bec0-4ade-8b58-7e65b78fb5e8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:15.230650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-40358502-bec0-4ade-8b58-7e65b78fb5e8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:15.297571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-40358502-bec0-4ade-8b58-7e65b78fb5e8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:15.307020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-40358502-bec0-4ade-8b58-7e65b78fb5e8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1214 microversion: 2.1 time: 0.082453 Jul 18 16:48:15.308664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 111/231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:15 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:15.792764 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-510ab3a9-980b-4860-b56c-6fd81704106a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:15.793369 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-510ab3a9-980b-4860-b56c-6fd81704106a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:15.799878 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-510ab3a9-980b-4860-b56c-6fd81704106a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:15.800326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-510ab3a9-980b-4860-b56c-6fd81704106a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:15.801091 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-510ab3a9-980b-4860-b56c-6fd81704106a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:15.801529 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-510ab3a9-980b-4860-b56c-6fd81704106a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:15.944142 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-510ab3a9-980b-4860-b56c-6fd81704106a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:15.952315 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-510ab3a9-980b-4860-b56c-6fd81704106a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.163522 Jul 18 16:48:15.952882 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 121/232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:15 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:15.968057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-11e1bfdb-51eb-453c-9186-56c8daf6e1aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:15.968666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-11e1bfdb-51eb-453c-9186-56c8daf6e1aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:15.975618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11e1bfdb-51eb-453c-9186-56c8daf6e1aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:15.976069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11e1bfdb-51eb-453c-9186-56c8daf6e1aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:15.976827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11e1bfdb-51eb-453c-9186-56c8daf6e1aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:15.977298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11e1bfdb-51eb-453c-9186-56c8daf6e1aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:16.118712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-11e1bfdb-51eb-453c-9186-56c8daf6e1aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:16.127897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-11e1bfdb-51eb-453c-9186-56c8daf6e1aa tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.164360 Jul 18 16:48:16.128465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 112/233] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:15 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:16.327626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-46795cd4-137a-44b1-af8f-7bdc8cf760f2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:16.328216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-46795cd4-137a-44b1-af8f-7bdc8cf760f2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:16.381536 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-46795cd4-137a-44b1-af8f-7bdc8cf760f2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:16.389337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-46795cd4-137a-44b1-af8f-7bdc8cf760f2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1214 microversion: 2.1 time: 0.065740 Jul 18 16:48:16.390069 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 122/234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:16 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:16.969147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a546820b-3f8a-4061-af70-8efa898c257a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:16.969755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a546820b-3f8a-4061-af70-8efa898c257a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:16.976897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a546820b-3f8a-4061-af70-8efa898c257a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:16.976897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a546820b-3f8a-4061-af70-8efa898c257a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:16.977564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a546820b-3f8a-4061-af70-8efa898c257a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:16.977998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a546820b-3f8a-4061-af70-8efa898c257a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:17.112390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a546820b-3f8a-4061-af70-8efa898c257a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:17.119871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a546820b-3f8a-4061-af70-8efa898c257a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.154453 Jul 18 16:48:17.120466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 113/235] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:16 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:17.145081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-eea0ee63-6030-452b-bc6e-74352bd3b6c8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:17.150339 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-eea0ee63-6030-452b-bc6e-74352bd3b6c8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:17.152619 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eea0ee63-6030-452b-bc6e-74352bd3b6c8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:17.153068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eea0ee63-6030-452b-bc6e-74352bd3b6c8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:17.153828 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eea0ee63-6030-452b-bc6e-74352bd3b6c8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:17.154263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eea0ee63-6030-452b-bc6e-74352bd3b6c8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:17.288018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-eea0ee63-6030-452b-bc6e-74352bd3b6c8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:17.296595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-eea0ee63-6030-452b-bc6e-74352bd3b6c8 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1509 microversion: 2.1 time: 0.155267 Jul 18 16:48:17.297162 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 123/236] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:17 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:17.411987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-40919da6-dfac-4fcf-8a00-1e7b16ff6b28 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:17.413170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-40919da6-dfac-4fcf-8a00-1e7b16ff6b28 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:17.420879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40919da6-dfac-4fcf-8a00-1e7b16ff6b28 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:17.421377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40919da6-dfac-4fcf-8a00-1e7b16ff6b28 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:17.422438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40919da6-dfac-4fcf-8a00-1e7b16ff6b28 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:17.422879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40919da6-dfac-4fcf-8a00-1e7b16ff6b28 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:17.493312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-40919da6-dfac-4fcf-8a00-1e7b16ff6b28 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:17.500818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-40919da6-dfac-4fcf-8a00-1e7b16ff6b28 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1218 microversion: 2.1 time: 0.096972 Jul 18 16:48:17.501380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 114/237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:17 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:18.094390 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ac75b18a-38d2-4bbb-a673-cbfc80f2a1c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:18.100672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac75b18a-38d2-4bbb-a673-cbfc80f2a1c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.101123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac75b18a-38d2-4bbb-a673-cbfc80f2a1c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.138330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-66afe7fe-0c82-4fde-94a7-194b369434ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:18.143601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-66afe7fe-0c82-4fde-94a7-194b369434ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:18.146482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66afe7fe-0c82-4fde-94a7-194b369434ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.147029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66afe7fe-0c82-4fde-94a7-194b369434ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.148169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66afe7fe-0c82-4fde-94a7-194b369434ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.148838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66afe7fe-0c82-4fde-94a7-194b369434ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.212496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ac75b18a-38d2-4bbb-a673-cbfc80f2a1c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Going to try to stop instance {{(pid=124945) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 16:48:18.319457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-66afe7fe-0c82-4fde-94a7-194b369434ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:18.329003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-66afe7fe-0c82-4fde-94a7-194b369434ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.195910 Jul 18 16:48:18.329584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 115/238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:18 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:18.334114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ca64f884-f186-4318-b6ab-7906e2770d61 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:18.334732 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ca64f884-f186-4318-b6ab-7906e2770d61 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:18.340760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca64f884-f186-4318-b6ab-7906e2770d61 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.341263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca64f884-f186-4318-b6ab-7906e2770d61 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.342014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca64f884-f186-4318-b6ab-7906e2770d61 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.342444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca64f884-f186-4318-b6ab-7906e2770d61 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.478086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ca64f884-f186-4318-b6ab-7906e2770d61 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:18.485954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ca64f884-f186-4318-b6ab-7906e2770d61 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1515 microversion: 2.1 time: 0.155414 Jul 18 16:48:18.486522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 116/239] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:18 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:18.527469 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ad02507d-cd1c-4f3b-8696-06c95e374985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:18.528295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ad02507d-cd1c-4f3b-8696-06c95e374985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:18.529622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ac75b18a-38d2-4bbb-a673-cbfc80f2a1c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/action" status: 202 len: 0 microversion: 2.1 time: 0.438815 Jul 18 16:48:18.530697 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 124/240] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 16:48:18 2022] POST /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:48:18.537296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ad02507d-cd1c-4f3b-8696-06c95e374985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.542474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ad02507d-cd1c-4f3b-8696-06c95e374985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.542474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ad02507d-cd1c-4f3b-8696-06c95e374985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.542702 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4c57670c-22e6-422b-8a27-3dfd867a0736 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:18.542792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ad02507d-cd1c-4f3b-8696-06c95e374985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.542874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4c57670c-22e6-422b-8a27-3dfd867a0736 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:18.546763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c57670c-22e6-422b-8a27-3dfd867a0736 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.547218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c57670c-22e6-422b-8a27-3dfd867a0736 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.548051 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c57670c-22e6-422b-8a27-3dfd867a0736 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:18.548795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c57670c-22e6-422b-8a27-3dfd867a0736 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:18.620896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ad02507d-cd1c-4f3b-8696-06c95e374985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:18.629751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ad02507d-cd1c-4f3b-8696-06c95e374985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1266 microversion: 2.1 time: 0.111425 Jul 18 16:48:18.641007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 117/241] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:18 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:18.696986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4c57670c-22e6-422b-8a27-3dfd867a0736 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:18.701634 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:18.707101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4c57670c-22e6-422b-8a27-3dfd867a0736 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1725 microversion: 2.1 time: 0.172532 Jul 18 16:48:18.707718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 125/242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:18 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:19.345643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-41a3327d-d12e-4b49-9194-3f81d78a0677 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:19.346262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-41a3327d-d12e-4b49-9194-3f81d78a0677 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:19.352877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41a3327d-d12e-4b49-9194-3f81d78a0677 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:19.353328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41a3327d-d12e-4b49-9194-3f81d78a0677 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:19.354253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41a3327d-d12e-4b49-9194-3f81d78a0677 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:19.354719 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41a3327d-d12e-4b49-9194-3f81d78a0677 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:19.492314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-41a3327d-d12e-4b49-9194-3f81d78a0677 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:19.500533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-41a3327d-d12e-4b49-9194-3f81d78a0677 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.158855 Jul 18 16:48:19.501107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 118/243] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:19 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:19.647434 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-42d9ac53-bc1d-4ab6-a858-837db9c8001a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:19.649906 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-42d9ac53-bc1d-4ab6-a858-837db9c8001a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:19.655616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42d9ac53-bc1d-4ab6-a858-837db9c8001a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:19.656069 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42d9ac53-bc1d-4ab6-a858-837db9c8001a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:19.656838 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42d9ac53-bc1d-4ab6-a858-837db9c8001a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:19.657358 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42d9ac53-bc1d-4ab6-a858-837db9c8001a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:19.725593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6ec52a5a-06e3-4394-8eea-2d367dd4d634 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:19.726339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6ec52a5a-06e3-4394-8eea-2d367dd4d634 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:19.736418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6ec52a5a-06e3-4394-8eea-2d367dd4d634 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:19.737023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6ec52a5a-06e3-4394-8eea-2d367dd4d634 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:19.737952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6ec52a5a-06e3-4394-8eea-2d367dd4d634 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:19.738674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6ec52a5a-06e3-4394-8eea-2d367dd4d634 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:19.743609 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-42d9ac53-bc1d-4ab6-a858-837db9c8001a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:19.752048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-42d9ac53-bc1d-4ab6-a858-837db9c8001a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1272 microversion: 2.1 time: 0.108367 Jul 18 16:48:19.753502 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 126/244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:19 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:19.905945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6ec52a5a-06e3-4394-8eea-2d367dd4d634 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:19.913880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6ec52a5a-06e3-4394-8eea-2d367dd4d634 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1725 microversion: 2.1 time: 0.192696 Jul 18 16:48:19.914443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 119/245] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:19 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:20.119401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7c49b0f7-64dc-445f-b55f-218a21c1a739 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Action: 'create', calling method: .version_select at 0x7fd6ae1bf9d0>, body: {"keypair": {"name": "tempest-keypair-894990276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgBv/bxnVZkmw7cEYjTAq0aeZBDFBruosALXHobfK3BqMXAf/qn9xXftHwqhlb12wYlVzzHYyaB+DQXpiYOK4YP7JAIg4ftSIEGUw+yMni4L6FgfCoc4y7qU+pkNrWtEA=="}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:20.154878 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-7c49b0f7-64dc-445f-b55f-218a21c1a739 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Getting quotas for project 69c48eddc2334918970e61725bedafd1. Resources: {'key_pairs'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:48:20.164663 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-7c49b0f7-64dc-445f-b55f-218a21c1a739 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Getting quotas for user 642ba7eed36e4956834c06b771259a42 and project 69c48eddc2334918970e61725bedafd1. Resources: {'key_pairs'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:48:20.308891 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7c49b0f7-64dc-445f-b55f-218a21c1a739 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.200381 Jul 18 16:48:20.309516 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 127/246] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 16:48:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:20.517186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-63077fad-02e1-4575-9b2b-401f00129e5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:20.517799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-63077fad-02e1-4575-9b2b-401f00129e5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:20.524725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63077fad-02e1-4575-9b2b-401f00129e5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:20.525176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63077fad-02e1-4575-9b2b-401f00129e5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:20.526022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63077fad-02e1-4575-9b2b-401f00129e5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:20.526591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63077fad-02e1-4575-9b2b-401f00129e5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:20.686357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-63077fad-02e1-4575-9b2b-401f00129e5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:20.694674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-63077fad-02e1-4575-9b2b-401f00129e5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1271 microversion: 2.1 time: 0.181327 Jul 18 16:48:20.705548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 120/247] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:20 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:20.770307 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-fed0e5c0-7975-452e-86aa-8749714484c6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:20.771528 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-fed0e5c0-7975-452e-86aa-8749714484c6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:20.778284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fed0e5c0-7975-452e-86aa-8749714484c6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:20.778947 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fed0e5c0-7975-452e-86aa-8749714484c6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:20.779929 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fed0e5c0-7975-452e-86aa-8749714484c6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:20.780581 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fed0e5c0-7975-452e-86aa-8749714484c6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:20.931303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-01b262fc-7777-4d57-94d7-f7e1d4a03fc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:20.932361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-01b262fc-7777-4d57-94d7-f7e1d4a03fc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:20.939180 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-01b262fc-7777-4d57-94d7-f7e1d4a03fc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:20.939760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-01b262fc-7777-4d57-94d7-f7e1d4a03fc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:20.940616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-01b262fc-7777-4d57-94d7-f7e1d4a03fc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:20.941265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-01b262fc-7777-4d57-94d7-f7e1d4a03fc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:20.970288 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-fed0e5c0-7975-452e-86aa-8749714484c6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:20.980101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-fed0e5c0-7975-452e-86aa-8749714484c6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1314 microversion: 2.1 time: 0.213508 Jul 18 16:48:20.980861 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 128/248] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:20 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:21.129251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-01b262fc-7777-4d57-94d7-f7e1d4a03fc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:21.139630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-01b262fc-7777-4d57-94d7-f7e1d4a03fc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1725 microversion: 2.1 time: 0.212091 Jul 18 16:48:21.140228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 121/249] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:20 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:21.432795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-9d0be99b-ab9e-40c7-8c2d-4fc08f7c0a15 req-9a1b1b79-f061-4f6f-ad48-2c213b01d9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9", "tag": "0b9a63ae-9c07-493b-a997-b9e5bf4114e8"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:21.442018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-9d0be99b-ab9e-40c7-8c2d-4fc08f7c0a15 req-9a1b1b79-f061-4f6f-ad48-2c213b01d9a7 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:21.442656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-9d0be99b-ab9e-40c7-8c2d-4fc08f7c0a15 req-9a1b1b79-f061-4f6f-ad48-2c213b01d9a7 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:21.460983 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-9d0be99b-ab9e-40c7-8c2d-4fc08f7c0a15 req-9a1b1b79-f061-4f6f-ad48-2c213b01d9a7 service nova] Creating event network-changed:0b9a63ae-9c07-493b-a997-b9e5bf4114e8 for instance b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 on hv-cinder-84617 Jul 18 16:48:21.466266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-9d0be99b-ab9e-40c7-8c2d-4fc08f7c0a15 req-9a1b1b79-f061-4f6f-ad48-2c213b01d9a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037614 Jul 18 16:48:21.467101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 129/250] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:21.722724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-59e0fc07-96a2-4941-b840-1d25fec91a29 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:21.722724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-59e0fc07-96a2-4941-b840-1d25fec91a29 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:21.735043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59e0fc07-96a2-4941-b840-1d25fec91a29 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:21.735517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59e0fc07-96a2-4941-b840-1d25fec91a29 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:21.736901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59e0fc07-96a2-4941-b840-1d25fec91a29 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:21.737348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59e0fc07-96a2-4941-b840-1d25fec91a29 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:21.898539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59e0fc07-96a2-4941-b840-1d25fec91a29 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:21.907127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-59e0fc07-96a2-4941-b840-1d25fec91a29 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1259 microversion: 2.1 time: 0.196262 Jul 18 16:48:21.907738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 122/251] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:21.997979 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-211a5b90-090c-4161-bea7-5351255b5a26 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:21.998787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-211a5b90-090c-4161-bea7-5351255b5a26 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:22.005625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-211a5b90-090c-4161-bea7-5351255b5a26 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:22.006062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-211a5b90-090c-4161-bea7-5351255b5a26 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:22.006832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-211a5b90-090c-4161-bea7-5351255b5a26 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:22.007263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-211a5b90-090c-4161-bea7-5351255b5a26 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:22.157266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ae62d683-32f9-420a-b0b7-d02ce90fd252 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:22.157883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ae62d683-32f9-420a-b0b7-d02ce90fd252 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:22.165198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ae62d683-32f9-420a-b0b7-d02ce90fd252 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:22.165660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ae62d683-32f9-420a-b0b7-d02ce90fd252 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:22.166438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ae62d683-32f9-420a-b0b7-d02ce90fd252 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:22.167484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ae62d683-32f9-420a-b0b7-d02ce90fd252 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:22.277831 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-211a5b90-090c-4161-bea7-5351255b5a26 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:22.286640 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-211a5b90-090c-4161-bea7-5351255b5a26 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1314 microversion: 2.1 time: 0.293552 Jul 18 16:48:22.287878 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 130/252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:21 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:22.319410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ae62d683-32f9-420a-b0b7-d02ce90fd252 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:22.327925 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ae62d683-32f9-420a-b0b7-d02ce90fd252 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1725 microversion: 2.1 time: 0.174451 Jul 18 16:48:22.328504 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 123/253] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:22.924642 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-532adfcd-5749-4efe-99ec-172b098a546b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:22.925519 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-532adfcd-5749-4efe-99ec-172b098a546b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:22.936427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-532adfcd-5749-4efe-99ec-172b098a546b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:22.937191 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-532adfcd-5749-4efe-99ec-172b098a546b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:22.937980 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-532adfcd-5749-4efe-99ec-172b098a546b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:22.938689 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-532adfcd-5749-4efe-99ec-172b098a546b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:23.190283 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-532adfcd-5749-4efe-99ec-172b098a546b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:23.204009 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-532adfcd-5749-4efe-99ec-172b098a546b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1259 microversion: 2.1 time: 0.283353 Jul 18 16:48:23.204895 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 131/254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1259 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:23.305595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5b33450d-b107-4cc6-944f-ea271b3207cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:23.306196 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5b33450d-b107-4cc6-944f-ea271b3207cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:23.314036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b33450d-b107-4cc6-944f-ea271b3207cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:23.315953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b33450d-b107-4cc6-944f-ea271b3207cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:23.315953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b33450d-b107-4cc6-944f-ea271b3207cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:23.315953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b33450d-b107-4cc6-944f-ea271b3207cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:23.345424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0d5bf607-4154-403f-a0ae-0a065c511077 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:23.346028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0d5bf607-4154-403f-a0ae-0a065c511077 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:23.353539 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0d5bf607-4154-403f-a0ae-0a065c511077 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:23.354850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0d5bf607-4154-403f-a0ae-0a065c511077 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:23.356141 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0d5bf607-4154-403f-a0ae-0a065c511077 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:23.356849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0d5bf607-4154-403f-a0ae-0a065c511077 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:23.466732 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5b33450d-b107-4cc6-944f-ea271b3207cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:23.475735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5b33450d-b107-4cc6-944f-ea271b3207cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1314 microversion: 2.1 time: 0.174052 Jul 18 16:48:23.476353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 124/255] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:23 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:23.620275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0d5bf607-4154-403f-a0ae-0a065c511077 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:23.630528 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0d5bf607-4154-403f-a0ae-0a065c511077 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1725 microversion: 2.1 time: 0.288821 Jul 18 16:48:23.635526 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 132/256] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:23 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:24.221919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-03aec403-2170-4237-98fe-65e11ec04bcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:24.222531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-03aec403-2170-4237-98fe-65e11ec04bcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:24.231317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03aec403-2170-4237-98fe-65e11ec04bcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:24.235819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03aec403-2170-4237-98fe-65e11ec04bcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:24.235819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03aec403-2170-4237-98fe-65e11ec04bcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:24.235819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03aec403-2170-4237-98fe-65e11ec04bcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:24.392216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-03aec403-2170-4237-98fe-65e11ec04bcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:24.399843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-03aec403-2170-4237-98fe-65e11ec04bcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1259 microversion: 2.1 time: 0.182618 Jul 18 16:48:24.400483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 125/257] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:24 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:24.445262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-123469569", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c726c5d-ab68-403e-98ff-f0508b7ceb81"}], "security_groups": [{"name": "tempest-securitygroup--451227046"}], "key_name": "tempest-keypair-894990276", "user_data": "}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:24.497300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5aca0865-ee3e-4146-9676-bdf6f8c9f3fd tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:24.498027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5aca0865-ee3e-4146-9676-bdf6f8c9f3fd tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:24.504947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5aca0865-ee3e-4146-9676-bdf6f8c9f3fd tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:24.505393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5aca0865-ee3e-4146-9676-bdf6f8c9f3fd tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:24.506163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5aca0865-ee3e-4146-9676-bdf6f8c9f3fd tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:24.506600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5aca0865-ee3e-4146-9676-bdf6f8c9f3fd tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:24.568859 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.network.neutron [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] validate_networks() for [('1c726c5d-ab68-403e-98ff-f0508b7ceb81', None, None, None, None, None)] {{(pid=124945) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:48:24.653322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5aca0865-ee3e-4146-9676-bdf6f8c9f3fd tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:24.662028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5aca0865-ee3e-4146-9676-bdf6f8c9f3fd tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1314 microversion: 2.1 time: 0.171446 Jul 18 16:48:24.662918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 126/258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:24 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:24.668835 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e6561e5a-20ca-4d6a-8897-6fa9c77cc51b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:24.669453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e6561e5a-20ca-4d6a-8897-6fa9c77cc51b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:24.676047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e6561e5a-20ca-4d6a-8897-6fa9c77cc51b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:24.676511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e6561e5a-20ca-4d6a-8897-6fa9c77cc51b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:24.677290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e6561e5a-20ca-4d6a-8897-6fa9c77cc51b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:24.677726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e6561e5a-20ca-4d6a-8897-6fa9c77cc51b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:24.919595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e6561e5a-20ca-4d6a-8897-6fa9c77cc51b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:24.932136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e6561e5a-20ca-4d6a-8897-6fa9c77cc51b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1725 microversion: 2.1 time: 0.268087 Jul 18 16:48:24.933191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 127/259] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1725 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:25.078308 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=2 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:25.285293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Flavor limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:48:25.285958 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Image limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:48:25.286436 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Flavor pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:48:25.286840 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Image pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:48:25.287274 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:48:25.296960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.297328 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.298720 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.299164 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.317511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Getting quotas for project 69c48eddc2334918970e61725bedafd1. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:48:25.321649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Getting quotas for user 642ba7eed36e4956834c06b771259a42 and project 69c48eddc2334918970e61725bedafd1. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:48:25.334318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Going to run 1 instances... {{(pid=124945) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:48:25.336621 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:48:25.421102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-073bde3e-aaff-437b-8e1a-fcb64175a5a7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:25.424132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-073bde3e-aaff-437b-8e1a-fcb64175a5a7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:25.431760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:25.436766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-073bde3e-aaff-437b-8e1a-fcb64175a5a7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.437565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-073bde3e-aaff-437b-8e1a-fcb64175a5a7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.439619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-073bde3e-aaff-437b-8e1a-fcb64175a5a7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.440409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-073bde3e-aaff-437b-8e1a-fcb64175a5a7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.475419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:25.514157 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c52cc035-2e09-47c2-87e2-b57abb1219c4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.072984 Jul 18 16:48:25.515082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 133/260] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 16:48:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:48:25.525678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dd2fd1e3-3d1e-40c3-9b15-740e907d8643 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:25.526973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dd2fd1e3-3d1e-40c3-9b15-740e907d8643 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:25.623724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dd2fd1e3-3d1e-40c3-9b15-740e907d8643 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:25.645133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dd2fd1e3-3d1e-40c3-9b15-740e907d8643 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1244 microversion: 2.1 time: 0.123489 Jul 18 16:48:25.645601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 134/261] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:25 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1244 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:25.671461 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-073bde3e-aaff-437b-8e1a-fcb64175a5a7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:25.679191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-073bde3e-aaff-437b-8e1a-fcb64175a5a7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1259 microversion: 2.1 time: 0.265522 Jul 18 16:48:25.679353 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9b196910-106c-423a-8a1c-47de3e418ac7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:25.679881 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9b196910-106c-423a-8a1c-47de3e418ac7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:25.680679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 128/262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1259 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:25.689341 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b196910-106c-423a-8a1c-47de3e418ac7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.690081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b196910-106c-423a-8a1c-47de3e418ac7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.691028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b196910-106c-423a-8a1c-47de3e418ac7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.691656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b196910-106c-423a-8a1c-47de3e418ac7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.860184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9b196910-106c-423a-8a1c-47de3e418ac7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:25.872921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9b196910-106c-423a-8a1c-47de3e418ac7 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1314 microversion: 2.1 time: 0.198238 Jul 18 16:48:25.873614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 135/263] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:25 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:25.880053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-049919a6-745e-4873-a12b-d016b4f8c7a6 req-fe1eed8e-6b70-4fdb-9d2b-6c059d96a12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9", "name": "network-vif-plugged", "status": "completed", "tag": "0b9a63ae-9c07-493b-a997-b9e5bf4114e8"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:25.890936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-049919a6-745e-4873-a12b-d016b4f8c7a6 req-fe1eed8e-6b70-4fdb-9d2b-6c059d96a12c service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.892171 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-049919a6-745e-4873-a12b-d016b4f8c7a6 req-fe1eed8e-6b70-4fdb-9d2b-6c059d96a12c service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.909508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-049919a6-745e-4873-a12b-d016b4f8c7a6 req-fe1eed8e-6b70-4fdb-9d2b-6c059d96a12c service nova] Creating event network-vif-plugged:0b9a63ae-9c07-493b-a997-b9e5bf4114e8 for instance b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 on hv-cinder-84617 Jul 18 16:48:25.919690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-049919a6-745e-4873-a12b-d016b4f8c7a6 req-fe1eed8e-6b70-4fdb-9d2b-6c059d96a12c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043724 Jul 18 16:48:25.920634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 129/264] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:25.954100 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c92761ca-c2c0-40bd-b1da-fdf07479ca44 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:25.954932 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c92761ca-c2c0-40bd-b1da-fdf07479ca44 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:25.962149 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c92761ca-c2c0-40bd-b1da-fdf07479ca44 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.962687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c92761ca-c2c0-40bd-b1da-fdf07479ca44 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:25.964088 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c92761ca-c2c0-40bd-b1da-fdf07479ca44 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:25.964748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c92761ca-c2c0-40bd-b1da-fdf07479ca44 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.161706 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c92761ca-c2c0-40bd-b1da-fdf07479ca44 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:26.173642 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c92761ca-c2c0-40bd-b1da-fdf07479ca44 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1725 microversion: 2.1 time: 0.226365 Jul 18 16:48:26.178405 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 136/265] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:26.662887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-20ae669e-f3c2-48fb-9143-5fbecd8fe646 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:26.666398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-20ae669e-f3c2-48fb-9143-5fbecd8fe646 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:26.672680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20ae669e-f3c2-48fb-9143-5fbecd8fe646 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.673436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20ae669e-f3c2-48fb-9143-5fbecd8fe646 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.674564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20ae669e-f3c2-48fb-9143-5fbecd8fe646 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.675197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20ae669e-f3c2-48fb-9143-5fbecd8fe646 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.698617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0e36d3e1-5455-4931-a7bd-35a4b233d745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:26.699456 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0e36d3e1-5455-4931-a7bd-35a4b233d745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:26.705851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e36d3e1-5455-4931-a7bd-35a4b233d745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.706380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e36d3e1-5455-4931-a7bd-35a4b233d745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.707220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e36d3e1-5455-4931-a7bd-35a4b233d745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.707761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e36d3e1-5455-4931-a7bd-35a4b233d745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.775446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-20ae669e-f3c2-48fb-9143-5fbecd8fe646 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:26.793361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-20ae669e-f3c2-48fb-9143-5fbecd8fe646 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1248 microversion: 2.1 time: 0.134509 Jul 18 16:48:26.802806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 130/266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:26 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1248 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:26.892077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d2b06dd9-202e-4a38-98d5-240e87d5d11d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:26.892807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d2b06dd9-202e-4a38-98d5-240e87d5d11d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:26.897074 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0e36d3e1-5455-4931-a7bd-35a4b233d745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:26.900304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d2b06dd9-202e-4a38-98d5-240e87d5d11d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.900832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d2b06dd9-202e-4a38-98d5-240e87d5d11d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.902587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d2b06dd9-202e-4a38-98d5-240e87d5d11d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:26.903121 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d2b06dd9-202e-4a38-98d5-240e87d5d11d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:26.905893 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0e36d3e1-5455-4931-a7bd-35a4b233d745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1259 microversion: 2.1 time: 0.211384 Jul 18 16:48:26.911629 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 137/267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:26 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:27.099638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d2b06dd9-202e-4a38-98d5-240e87d5d11d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:27.115857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d2b06dd9-202e-4a38-98d5-240e87d5d11d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1314 microversion: 2.1 time: 0.227793 Jul 18 16:48:27.117296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 131/268] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:26 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:27.190009 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e6303c08-c577-4241-b93a-1e64122a064e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:27.190964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e6303c08-c577-4241-b93a-1e64122a064e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:27.193061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:27.198971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6303c08-c577-4241-b93a-1e64122a064e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:27.199703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6303c08-c577-4241-b93a-1e64122a064e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:27.200684 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6303c08-c577-4241-b93a-1e64122a064e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:27.201275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6303c08-c577-4241-b93a-1e64122a064e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:27.350456 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e6303c08-c577-4241-b93a-1e64122a064e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:27.358506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e6303c08-c577-4241-b93a-1e64122a064e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1725 microversion: 2.1 time: 0.172380 Jul 18 16:48:27.359064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 138/269] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:27.818334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e12161cb-b6d8-4ce0-9e07-8f06b8b4c94e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:27.821328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e12161cb-b6d8-4ce0-9e07-8f06b8b4c94e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:27.841532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e12161cb-b6d8-4ce0-9e07-8f06b8b4c94e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:27.841979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e12161cb-b6d8-4ce0-9e07-8f06b8b4c94e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:27.842843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e12161cb-b6d8-4ce0-9e07-8f06b8b4c94e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:27.843207 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e12161cb-b6d8-4ce0-9e07-8f06b8b4c94e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:27.917336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e12161cb-b6d8-4ce0-9e07-8f06b8b4c94e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:27.923414 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4295eb08-14d7-4570-bd93-89ec9eaffec3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:27.924492 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4295eb08-14d7-4570-bd93-89ec9eaffec3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:27.931566 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4295eb08-14d7-4570-bd93-89ec9eaffec3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:27.933418 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4295eb08-14d7-4570-bd93-89ec9eaffec3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:27.935023 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4295eb08-14d7-4570-bd93-89ec9eaffec3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:27.935777 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4295eb08-14d7-4570-bd93-89ec9eaffec3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:27.936416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e12161cb-b6d8-4ce0-9e07-8f06b8b4c94e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1296 microversion: 2.1 time: 0.123821 Jul 18 16:48:27.938018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 132/270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:27 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:28.137658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-93a5110d-70de-4e07-a1e2-fd204ce7c684 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:28.138416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-93a5110d-70de-4e07-a1e2-fd204ce7c684 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:28.144858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93a5110d-70de-4e07-a1e2-fd204ce7c684 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:28.145311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93a5110d-70de-4e07-a1e2-fd204ce7c684 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:28.146089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93a5110d-70de-4e07-a1e2-fd204ce7c684 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:28.146525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93a5110d-70de-4e07-a1e2-fd204ce7c684 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:28.181505 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4295eb08-14d7-4570-bd93-89ec9eaffec3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:28.194745 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4295eb08-14d7-4570-bd93-89ec9eaffec3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1259 microversion: 2.1 time: 0.275933 Jul 18 16:48:28.204315 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 139/271] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:28.296550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-93a5110d-70de-4e07-a1e2-fd204ce7c684 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:28.314761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-93a5110d-70de-4e07-a1e2-fd204ce7c684 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1314 microversion: 2.1 time: 0.181017 Jul 18 16:48:28.315264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 133/272] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:28 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:28.375432 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-319b3f73-e593-4a67-a36c-d1633ab7a778 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:28.376080 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-319b3f73-e593-4a67-a36c-d1633ab7a778 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:28.382214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-319b3f73-e593-4a67-a36c-d1633ab7a778 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:28.386629 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-319b3f73-e593-4a67-a36c-d1633ab7a778 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:28.386629 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-319b3f73-e593-4a67-a36c-d1633ab7a778 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:28.386629 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-319b3f73-e593-4a67-a36c-d1633ab7a778 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:28.671212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-319b3f73-e593-4a67-a36c-d1633ab7a778 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:28.681560 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-319b3f73-e593-4a67-a36c-d1633ab7a778 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1725 microversion: 2.1 time: 0.309953 Jul 18 16:48:28.684789 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 140/273] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:28 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1725 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:28.955633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-188541ec-80da-44bd-9f46-4aec0f7cab0c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:28.957000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-188541ec-80da-44bd-9f46-4aec0f7cab0c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:28.965880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-188541ec-80da-44bd-9f46-4aec0f7cab0c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:28.967505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-188541ec-80da-44bd-9f46-4aec0f7cab0c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:28.968541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-188541ec-80da-44bd-9f46-4aec0f7cab0c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:28.969259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-188541ec-80da-44bd-9f46-4aec0f7cab0c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.054424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-188541ec-80da-44bd-9f46-4aec0f7cab0c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:29.062617 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-188541ec-80da-44bd-9f46-4aec0f7cab0c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1304 microversion: 2.1 time: 0.112805 Jul 18 16:48:29.063738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 134/274] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:28 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:29.212319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6738170f-0ca4-44c3-8657-4943e9c567ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:29.215096 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6738170f-0ca4-44c3-8657-4943e9c567ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:29.222890 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6738170f-0ca4-44c3-8657-4943e9c567ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.223849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6738170f-0ca4-44c3-8657-4943e9c567ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.224799 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6738170f-0ca4-44c3-8657-4943e9c567ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.225564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6738170f-0ca4-44c3-8657-4943e9c567ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.334067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d228c2a4-1860-4a5f-a391-7c483e4685d2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:29.340856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d228c2a4-1860-4a5f-a391-7c483e4685d2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:29.343803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d228c2a4-1860-4a5f-a391-7c483e4685d2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.344538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d228c2a4-1860-4a5f-a391-7c483e4685d2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.345976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d228c2a4-1860-4a5f-a391-7c483e4685d2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.347832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d228c2a4-1860-4a5f-a391-7c483e4685d2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.481041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6738170f-0ca4-44c3-8657-4943e9c567ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:29.493876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6738170f-0ca4-44c3-8657-4943e9c567ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1259 microversion: 2.1 time: 0.285273 Jul 18 16:48:29.506863 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 141/275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:29 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1259 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:29.560141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d228c2a4-1860-4a5f-a391-7c483e4685d2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:29.567973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d228c2a4-1860-4a5f-a391-7c483e4685d2 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1497 microversion: 2.1 time: 0.238576 Jul 18 16:48:29.568640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 135/276] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:29 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1497 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:29.700618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d2b30c0b-fe6b-4e69-8b2e-a7fa4556e34e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:29.701233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d2b30c0b-fe6b-4e69-8b2e-a7fa4556e34e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:29.707974 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d2b30c0b-fe6b-4e69-8b2e-a7fa4556e34e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.709060 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d2b30c0b-fe6b-4e69-8b2e-a7fa4556e34e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.709500 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d2b30c0b-fe6b-4e69-8b2e-a7fa4556e34e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.710167 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d2b30c0b-fe6b-4e69-8b2e-a7fa4556e34e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.885075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-f87076a8-58ef-49bc-b6e8-dc9d30060a7b req-94c09623-187e-4e3b-b541-bc6215ed403b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1c9245-f7e5-4ff8-b561-7dc29e139931", "name": "network-vif-plugged", "status": "completed", "tag": "58e840d1-84ce-4ac8-bb93-2ee5a430d89d"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:29.898809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f87076a8-58ef-49bc-b6e8-dc9d30060a7b req-94c09623-187e-4e3b-b541-bc6215ed403b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.899311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f87076a8-58ef-49bc-b6e8-dc9d30060a7b req-94c09623-187e-4e3b-b541-bc6215ed403b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.907774 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d2b30c0b-fe6b-4e69-8b2e-a7fa4556e34e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:29.927991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-f87076a8-58ef-49bc-b6e8-dc9d30060a7b req-94c09623-187e-4e3b-b541-bc6215ed403b service nova] Creating event network-vif-plugged:58e840d1-84ce-4ac8-bb93-2ee5a430d89d for instance 6f1c9245-f7e5-4ff8-b561-7dc29e139931 on hv-cinder-84617 Jul 18 16:48:29.928808 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d2b30c0b-fe6b-4e69-8b2e-a7fa4556e34e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1702 microversion: 2.1 time: 0.232478 Jul 18 16:48:29.934483 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 142/277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:29 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1702 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:29.936665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-f87076a8-58ef-49bc-b6e8-dc9d30060a7b req-94c09623-187e-4e3b-b541-bc6215ed403b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056436 Jul 18 16:48:29.942443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 136/278] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:29.947733 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9fca68a3-e58e-4408-8242-6deec8b7feee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:29.959615 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9fca68a3-e58e-4408-8242-6deec8b7feee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:29.960074 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9fca68a3-e58e-4408-8242-6deec8b7feee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:29.997192 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9fca68a3-e58e-4408-8242-6deec8b7feee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Going to try to start instance {{(pid=124945) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 16:48:30.081409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-35a72934-dd89-4fc1-8ab2-5b5347b2cb7d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:30.082888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-35a72934-dd89-4fc1-8ab2-5b5347b2cb7d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:30.091768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-35a72934-dd89-4fc1-8ab2-5b5347b2cb7d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.092538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-35a72934-dd89-4fc1-8ab2-5b5347b2cb7d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.093649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-35a72934-dd89-4fc1-8ab2-5b5347b2cb7d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.094315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-35a72934-dd89-4fc1-8ab2-5b5347b2cb7d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.282358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-35a72934-dd89-4fc1-8ab2-5b5347b2cb7d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:30.304422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-35a72934-dd89-4fc1-8ab2-5b5347b2cb7d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.227474 Jul 18 16:48:30.316150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 137/279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:30 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:30.325523 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9fca68a3-e58e-4408-8242-6deec8b7feee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/action" status: 202 len: 0 microversion: 2.1 time: 0.381457 Jul 18 16:48:30.327039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 143/280] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 16:48:29 2022] POST /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:48:30.343341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-931e9c2a-ec8b-409b-a77a-81c69285ff27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:30.350439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-931e9c2a-ec8b-409b-a77a-81c69285ff27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:30.364187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-931e9c2a-ec8b-409b-a77a-81c69285ff27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.364636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-931e9c2a-ec8b-409b-a77a-81c69285ff27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.365419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-931e9c2a-ec8b-409b-a77a-81c69285ff27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.366978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-931e9c2a-ec8b-409b-a77a-81c69285ff27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.514129 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-86c5070a-51dc-4e39-886d-b753e8952b45 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:30.515137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-86c5070a-51dc-4e39-886d-b753e8952b45 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:30.528124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-86c5070a-51dc-4e39-886d-b753e8952b45 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.532145 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-86c5070a-51dc-4e39-886d-b753e8952b45 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.533035 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-86c5070a-51dc-4e39-886d-b753e8952b45 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.533597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-86c5070a-51dc-4e39-886d-b753e8952b45 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.634879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-931e9c2a-ec8b-409b-a77a-81c69285ff27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:30.645703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-931e9c2a-ec8b-409b-a77a-81c69285ff27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1711 microversion: 2.1 time: 0.312273 Jul 18 16:48:30.646537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 138/281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1711 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:30.765928 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-86c5070a-51dc-4e39-886d-b753e8952b45 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:30.771555 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:30.778717 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-86c5070a-51dc-4e39-886d-b753e8952b45 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1259 microversion: 2.1 time: 0.269226 Jul 18 16:48:30.780356 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 144/282] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:30 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:30.846970 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-746ca843-9443-4c87-b713-a2cd79c91e12 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:30.847595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-746ca843-9443-4c87-b713-a2cd79c91e12 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:30.854199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-746ca843-9443-4c87-b713-a2cd79c91e12 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.855214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-746ca843-9443-4c87-b713-a2cd79c91e12 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.856034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-746ca843-9443-4c87-b713-a2cd79c91e12 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:30.856650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-746ca843-9443-4c87-b713-a2cd79c91e12 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:30.883996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-746ca843-9443-4c87-b713-a2cd79c91e12 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:48:31.322333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d370b493-3a47-4776-bf03-660caf658174 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:31.322924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d370b493-3a47-4776-bf03-660caf658174 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:31.329363 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d370b493-3a47-4776-bf03-660caf658174 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:31.329969 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d370b493-3a47-4776-bf03-660caf658174 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:31.330608 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d370b493-3a47-4776-bf03-660caf658174 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:31.337089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d370b493-3a47-4776-bf03-660caf658174 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:31.458616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-746ca843-9443-4c87-b713-a2cd79c91e12 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 204 len: 0 microversion: 2.1 time: 0.615395 Jul 18 16:48:31.464582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 139/283] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 16:48:30 2022] DELETE /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:48:31.476557 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d40af538-f71f-4249-9c30-5841f0bc1fe9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:31.478884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d40af538-f71f-4249-9c30-5841f0bc1fe9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:31.495413 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d40af538-f71f-4249-9c30-5841f0bc1fe9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:31.496185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d40af538-f71f-4249-9c30-5841f0bc1fe9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:31.497147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d40af538-f71f-4249-9c30-5841f0bc1fe9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:31.497732 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d40af538-f71f-4249-9c30-5841f0bc1fe9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:31.535368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d370b493-3a47-4776-bf03-660caf658174 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:31.551653 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d370b493-3a47-4776-bf03-660caf658174 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.231894 Jul 18 16:48:31.559862 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 145/284] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:31 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:31.572637 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-3c5d7c48-f9df-47ef-84e0-25b1b4d14489 req-946f6439-95c6-4a75-b64d-81962360f61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66", "tag": "92032a26-dcdf-4f60-ac35-52156a6604c6"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:31.609427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-3c5d7c48-f9df-47ef-84e0-25b1b4d14489 req-946f6439-95c6-4a75-b64d-81962360f61e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:31.609866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-3c5d7c48-f9df-47ef-84e0-25b1b4d14489 req-946f6439-95c6-4a75-b64d-81962360f61e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:31.631311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-3c5d7c48-f9df-47ef-84e0-25b1b4d14489 req-946f6439-95c6-4a75-b64d-81962360f61e service nova] Creating event network-changed:92032a26-dcdf-4f60-ac35-52156a6604c6 for instance 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 on hv-cinder-84617 Jul 18 16:48:31.637211 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-3c5d7c48-f9df-47ef-84e0-25b1b4d14489 req-946f6439-95c6-4a75-b64d-81962360f61e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071745 Jul 18 16:48:31.637952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 146/285] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:31.645827 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1219434115", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "networks": [{"uuid": "28e22456-0921-40bd-9ae0-f99d89608f3d"}]}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:31.710981 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.network.neutron [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] validate_networks() for [('28e22456-0921-40bd-9ae0-f99d89608f3d', None, None, None, None, None)] {{(pid=124945) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:48:31.732125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d40af538-f71f-4249-9c30-5841f0bc1fe9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:31.740583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d40af538-f71f-4249-9c30-5841f0bc1fe9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1503 microversion: 2.1 time: 0.274277 Jul 18 16:48:31.743579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 140/286] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:31 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:31.754998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6b30336e-8567-494e-8130-67edd6f9902f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:31.754998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6b30336e-8567-494e-8130-67edd6f9902f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:31.756575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b30336e-8567-494e-8130-67edd6f9902f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:31.757025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b30336e-8567-494e-8130-67edd6f9902f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:31.758008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b30336e-8567-494e-8130-67edd6f9902f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:31.758448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b30336e-8567-494e-8130-67edd6f9902f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:31.916181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6b30336e-8567-494e-8130-67edd6f9902f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:31.924642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6b30336e-8567-494e-8130-67edd6f9902f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1711 microversion: 2.1 time: 0.182008 Jul 18 16:48:31.925454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 141/287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1711 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:31.930376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-12d90ab3-ab8c-40af-8d48-330ae37a5948 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:31.931365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-12d90ab3-ab8c-40af-8d48-330ae37a5948 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:31.939593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12d90ab3-ab8c-40af-8d48-330ae37a5948 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:31.940269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12d90ab3-ab8c-40af-8d48-330ae37a5948 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:31.941312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12d90ab3-ab8c-40af-8d48-330ae37a5948 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:31.941964 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12d90ab3-ab8c-40af-8d48-330ae37a5948 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.083824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-12d90ab3-ab8c-40af-8d48-330ae37a5948 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:32.092444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-12d90ab3-ab8c-40af-8d48-330ae37a5948 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1259 microversion: 2.1 time: 0.165819 Jul 18 16:48:32.094729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 142/288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:31 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:32.118179 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Flavor limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:48:32.118696 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Image limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:48:32.119430 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Flavor pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:48:32.123440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Image pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:48:32.123440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:48:32.130449 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.130894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.131744 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.132181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.152156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Getting quotas for project 8368f31817254dafaea912485f3aa86b. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:48:32.156428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Getting quotas for user a9452b2e7f334f0387ecfe7194a7b38b and project 8368f31817254dafaea912485f3aa86b. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:48:32.169866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Going to run 1 instances... {{(pid=124945) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:48:32.172378 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:48:32.357587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f7acfd2e-8216-4a09-94f4-776cdf059b5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718326 Jul 18 16:48:32.358332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 147/289] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 16:48:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:48:32.385983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f40354c2-02dd-4a7e-a062-28dc2bd61a4c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:32.385983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f40354c2-02dd-4a7e-a062-28dc2bd61a4c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:32.465484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f40354c2-02dd-4a7e-a062-28dc2bd61a4c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:32.472578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f40354c2-02dd-4a7e-a062-28dc2bd61a4c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1219 microversion: 2.1 time: 0.108145 Jul 18 16:48:32.473234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 143/290] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:32 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:32.569120 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4fe0708c-3e21-4d79-b4f1-50a6a2008145 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:32.569801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4fe0708c-3e21-4d79-b4f1-50a6a2008145 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:32.576581 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4fe0708c-3e21-4d79-b4f1-50a6a2008145 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.577026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4fe0708c-3e21-4d79-b4f1-50a6a2008145 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.578049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4fe0708c-3e21-4d79-b4f1-50a6a2008145 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.578486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4fe0708c-3e21-4d79-b4f1-50a6a2008145 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.719794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4fe0708c-3e21-4d79-b4f1-50a6a2008145 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:32.727075 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4fe0708c-3e21-4d79-b4f1-50a6a2008145 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.161741 Jul 18 16:48:32.727671 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 148/291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:32 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:32.770672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0ddbaa72-e0b3-415f-bc46-0c02f1ab4e8b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:32.771359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0ddbaa72-e0b3-415f-bc46-0c02f1ab4e8b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:32.773391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:32.781319 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ddbaa72-e0b3-415f-bc46-0c02f1ab4e8b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.781766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ddbaa72-e0b3-415f-bc46-0c02f1ab4e8b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.782706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ddbaa72-e0b3-415f-bc46-0c02f1ab4e8b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.783148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ddbaa72-e0b3-415f-bc46-0c02f1ab4e8b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.943593 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0e6c37c8-c171-4fe9-9aa8-9d1e82f7f3e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:32.944518 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0e6c37c8-c171-4fe9-9aa8-9d1e82f7f3e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:32.956590 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e6c37c8-c171-4fe9-9aa8-9d1e82f7f3e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.966555 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e6c37c8-c171-4fe9-9aa8-9d1e82f7f3e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:32.968952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e6c37c8-c171-4fe9-9aa8-9d1e82f7f3e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:32.984491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e6c37c8-c171-4fe9-9aa8-9d1e82f7f3e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.015868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0ddbaa72-e0b3-415f-bc46-0c02f1ab4e8b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:33.023877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0ddbaa72-e0b3-415f-bc46-0c02f1ab4e8b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1503 microversion: 2.1 time: 0.257002 Jul 18 16:48:33.027301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 144/292] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:32 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:33.114896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bf2c5e87-2746-4326-9062-d1d1873110f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:33.115869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bf2c5e87-2746-4326-9062-d1d1873110f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:33.128159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e87-2746-4326-9062-d1d1873110f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.129421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e87-2746-4326-9062-d1d1873110f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.131541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e87-2746-4326-9062-d1d1873110f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.134462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf2c5e87-2746-4326-9062-d1d1873110f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.179516 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0e6c37c8-c171-4fe9-9aa8-9d1e82f7f3e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:33.189209 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0e6c37c8-c171-4fe9-9aa8-9d1e82f7f3e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1711 microversion: 2.1 time: 0.250754 Jul 18 16:48:33.190146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 149/293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1711 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:33.418632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bf2c5e87-2746-4326-9062-d1d1873110f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:33.422025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:33.426943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bf2c5e87-2746-4326-9062-d1d1873110f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1442 microversion: 2.1 time: 0.321815 Jul 18 16:48:33.428558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 145/294] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1442 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:33.445233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-554bc022-54d5-4310-aa45-5f261338ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:33.445842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-554bc022-54d5-4310-aa45-5f261338ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:33.455056 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-554bc022-54d5-4310-aa45-5f261338ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.455533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-554bc022-54d5-4310-aa45-5f261338ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.456297 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-554bc022-54d5-4310-aa45-5f261338ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.456732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-554bc022-54d5-4310-aa45-5f261338ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.493919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-53758cb3-3b44-4437-8dcb-d04327e1bb10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:33.495429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-53758cb3-3b44-4437-8dcb-d04327e1bb10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:33.611654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-53758cb3-3b44-4437-8dcb-d04327e1bb10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:33.623052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-53758cb3-3b44-4437-8dcb-d04327e1bb10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1219 microversion: 2.1 time: 0.136241 Jul 18 16:48:33.623656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 146/295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:33 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:33.744871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dd89288d-46f6-4c13-8017-7ee54823ef7f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:33.746041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-dd89288d-46f6-4c13-8017-7ee54823ef7f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:33.752327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dd89288d-46f6-4c13-8017-7ee54823ef7f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.753066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dd89288d-46f6-4c13-8017-7ee54823ef7f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.754158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dd89288d-46f6-4c13-8017-7ee54823ef7f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:33.754670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dd89288d-46f6-4c13-8017-7ee54823ef7f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:33.755922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-554bc022-54d5-4310-aa45-5f261338ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:33.765525 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-554bc022-54d5-4310-aa45-5f261338ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1442 microversion: 2.1 time: 0.324466 Jul 18 16:48:33.766606 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 150/296] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1442 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:33.997762 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-dd89288d-46f6-4c13-8017-7ee54823ef7f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:34.005213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dd89288d-46f6-4c13-8017-7ee54823ef7f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.264154 Jul 18 16:48:34.005785 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 147/297] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:33 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:34.040803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec8ca1ef-154b-41af-86f2-7efbcc7707a8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:34.041629 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ec8ca1ef-154b-41af-86f2-7efbcc7707a8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:34.047831 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8ca1ef-154b-41af-86f2-7efbcc7707a8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.048264 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8ca1ef-154b-41af-86f2-7efbcc7707a8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.049016 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8ca1ef-154b-41af-86f2-7efbcc7707a8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.049523 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8ca1ef-154b-41af-86f2-7efbcc7707a8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.195983 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ec8ca1ef-154b-41af-86f2-7efbcc7707a8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:34.205289 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ec8ca1ef-154b-41af-86f2-7efbcc7707a8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1503 microversion: 2.1 time: 0.168290 Jul 18 16:48:34.205854 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 151/298] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:34 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:34.206652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-47a848e8-ce3e-4b11-b4c8-1a0c30146dd4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:34.207270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-47a848e8-ce3e-4b11-b4c8-1a0c30146dd4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:34.214601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-47a848e8-ce3e-4b11-b4c8-1a0c30146dd4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.215308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-47a848e8-ce3e-4b11-b4c8-1a0c30146dd4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.216138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-47a848e8-ce3e-4b11-b4c8-1a0c30146dd4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.216578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-47a848e8-ce3e-4b11-b4c8-1a0c30146dd4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.580759 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-47a848e8-ce3e-4b11-b4c8-1a0c30146dd4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:34.594877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-47a848e8-ce3e-4b11-b4c8-1a0c30146dd4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1711 microversion: 2.1 time: 0.392449 Jul 18 16:48:34.596328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 148/299] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:34 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1711 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:34.642231 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2957d07c-9bdd-40bf-8d1e-a694f89567d3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:34.643087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2957d07c-9bdd-40bf-8d1e-a694f89567d3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:34.650235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2957d07c-9bdd-40bf-8d1e-a694f89567d3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.650958 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2957d07c-9bdd-40bf-8d1e-a694f89567d3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.654460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2957d07c-9bdd-40bf-8d1e-a694f89567d3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.655374 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2957d07c-9bdd-40bf-8d1e-a694f89567d3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.701066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-cbd4dbdb-5901-45c1-8ce1-62f760c3943a req-f67e6e6d-7864-41ef-b0d5-606fda48046e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9", "name": "network-vif-deleted", "tag": "0b9a63ae-9c07-493b-a997-b9e5bf4114e8"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:34.714445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-cbd4dbdb-5901-45c1-8ce1-62f760c3943a req-f67e6e6d-7864-41ef-b0d5-606fda48046e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:34.715453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-cbd4dbdb-5901-45c1-8ce1-62f760c3943a req-f67e6e6d-7864-41ef-b0d5-606fda48046e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:34.732093 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-cbd4dbdb-5901-45c1-8ce1-62f760c3943a req-f67e6e6d-7864-41ef-b0d5-606fda48046e service nova] Creating event network-vif-deleted:0b9a63ae-9c07-493b-a997-b9e5bf4114e8 for instance b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 on hv-cinder-84617 Jul 18 16:48:34.740761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-cbd4dbdb-5901-45c1-8ce1-62f760c3943a req-f67e6e6d-7864-41ef-b0d5-606fda48046e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046115 Jul 18 16:48:34.742379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 149/300] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:35.023036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-463a0d94-76c3-4adf-9741-fbe560f7b0ed tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:35.023913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-463a0d94-76c3-4adf-9741-fbe560f7b0ed tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:35.031454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-463a0d94-76c3-4adf-9741-fbe560f7b0ed tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.031959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-463a0d94-76c3-4adf-9741-fbe560f7b0ed tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.032779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-463a0d94-76c3-4adf-9741-fbe560f7b0ed tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.033224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-463a0d94-76c3-4adf-9741-fbe560f7b0ed tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.078404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2957d07c-9bdd-40bf-8d1e-a694f89567d3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:35.086288 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2957d07c-9bdd-40bf-8d1e-a694f89567d3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1215 microversion: 2.1 time: 0.448825 Jul 18 16:48:35.087134 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 152/301] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:34 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1215 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:35.223183 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:35.223811 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:35.229967 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.230410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.231170 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.231625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.264939 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.265388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.265833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.objects.instance [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lazy-loading 'fault' on Instance uuid b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 {{(pid=124945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:48:35.279898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-463a0d94-76c3-4adf-9741-fbe560f7b0ed tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:35.289641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-463a0d94-76c3-4adf-9741-fbe560f7b0ed tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.270647 Jul 18 16:48:35.290309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 150/302] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:35 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:35.320773 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:35.332414 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2955b475-ba2c-4b1f-856e-17f7dc5bcb48 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1304 microversion: 2.1 time: 0.112993 Jul 18 16:48:35.333333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 153/303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:35 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:35.612600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-78db4103-bf2c-4a21-9c09-7868b054e024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:35.613257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-78db4103-bf2c-4a21-9c09-7868b054e024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:35.631016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78db4103-bf2c-4a21-9c09-7868b054e024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.631298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78db4103-bf2c-4a21-9c09-7868b054e024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.632168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78db4103-bf2c-4a21-9c09-7868b054e024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:35.632605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78db4103-bf2c-4a21-9c09-7868b054e024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:35.923866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-78db4103-bf2c-4a21-9c09-7868b054e024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:35.933356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-78db4103-bf2c-4a21-9c09-7868b054e024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1715 microversion: 2.1 time: 0.324891 Jul 18 16:48:35.934024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 151/304] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1715 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:36.105177 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d5644dcc-51ba-4dd3-b558-4a42bf95d377 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:36.105796 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d5644dcc-51ba-4dd3-b558-4a42bf95d377 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:36.115516 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d5644dcc-51ba-4dd3-b558-4a42bf95d377 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:36.116153 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d5644dcc-51ba-4dd3-b558-4a42bf95d377 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.117224 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d5644dcc-51ba-4dd3-b558-4a42bf95d377 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:36.117695 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d5644dcc-51ba-4dd3-b558-4a42bf95d377 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.182456 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d5644dcc-51ba-4dd3-b558-4a42bf95d377 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:36.190430 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d5644dcc-51ba-4dd3-b558-4a42bf95d377 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1279 microversion: 2.1 time: 0.088963 Jul 18 16:48:36.191105 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 154/305] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:36 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:36.306869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a9783210-f35e-412a-842f-2e231011aca9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:36.308101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a9783210-f35e-412a-842f-2e231011aca9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:36.317251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a9783210-f35e-412a-842f-2e231011aca9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:36.317708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a9783210-f35e-412a-842f-2e231011aca9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.318536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a9783210-f35e-412a-842f-2e231011aca9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:36.319692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a9783210-f35e-412a-842f-2e231011aca9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.350149 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:36.351108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:36.358767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:36.363436 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.363436 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:36.363436 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.400814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:36.401669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:36.402363 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.objects.instance [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lazy-loading 'fault' on Instance uuid b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 {{(pid=124945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:48:36.538079 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:36.546830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ec8cf272-8c12-4d55-b90e-924a029c942a tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 200 len: 1304 microversion: 2.1 time: 0.200578 Jul 18 16:48:36.556358 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 155/306] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:36 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 1304 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:36.579008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a9783210-f35e-412a-842f-2e231011aca9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:36.587560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a9783210-f35e-412a-842f-2e231011aca9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.285052 Jul 18 16:48:36.588430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 152/307] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:36 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:37.060372 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-64314905-059f-45e0-a473-d8eda56455c0 req-e4ad4a7d-65a8-4bc0-825a-cb405fc0e67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1c9245-f7e5-4ff8-b561-7dc29e139931", "tag": "58e840d1-84ce-4ac8-bb93-2ee5a430d89d"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:37.069086 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-64314905-059f-45e0-a473-d8eda56455c0 req-e4ad4a7d-65a8-4bc0-825a-cb405fc0e67a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.069907 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-64314905-059f-45e0-a473-d8eda56455c0 req-e4ad4a7d-65a8-4bc0-825a-cb405fc0e67a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.086016 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-64314905-059f-45e0-a473-d8eda56455c0 req-e4ad4a7d-65a8-4bc0-825a-cb405fc0e67a service nova] Creating event network-changed:58e840d1-84ce-4ac8-bb93-2ee5a430d89d for instance 6f1c9245-f7e5-4ff8-b561-7dc29e139931 on hv-cinder-84617 Jul 18 16:48:37.092843 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-64314905-059f-45e0-a473-d8eda56455c0 req-e4ad4a7d-65a8-4bc0-825a-cb405fc0e67a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037731 Jul 18 16:48:37.094049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 156/308] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:37.208053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-971e66f4-aa4b-4008-ab94-087282990c46 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:37.208749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-971e66f4-aa4b-4008-ab94-087282990c46 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:37.225287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-971e66f4-aa4b-4008-ab94-087282990c46 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.225971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-971e66f4-aa4b-4008-ab94-087282990c46 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.226907 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-971e66f4-aa4b-4008-ab94-087282990c46 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.227526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-971e66f4-aa4b-4008-ab94-087282990c46 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.337348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-971e66f4-aa4b-4008-ab94-087282990c46 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:37.349798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-971e66f4-aa4b-4008-ab94-087282990c46 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1277 microversion: 2.1 time: 0.144866 Jul 18 16:48:37.350897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 153/309] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:37 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:37.566204 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:37.569999 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:37.595333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.596050 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.600172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.600868 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.605763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-822b507f-9714-48e7-991b-e8018abd5e05 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:37.606813 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-822b507f-9714-48e7-991b-e8018abd5e05 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:37.627278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-822b507f-9714-48e7-991b-e8018abd5e05 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.628618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-822b507f-9714-48e7-991b-e8018abd5e05 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.634334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] HTTP exception thrown: Instance b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 could not be found. Jul 18 16:48:37.635691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-822b507f-9714-48e7-991b-e8018abd5e05 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:37.637029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-822b507f-9714-48e7-991b-e8018abd5e05 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Request method failure captured: Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 HTTP/1.1 Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y7Ja1N0sF8vxclxVMGfwVJrh35eTT-lDJnLUy_UClcpsq241rwCOTv4OdZlsbe-YMYYc0c5Id3HNu0fO8rOhfRVlg1u8HHU8tD5Qvvyh--jif9it6FrWISmbk9GuU3n3td7IQxzRCOmQ86-UDH3fSuebWsWdAVh9dLEp1ctT6MWut0 Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: b2153f74cf4b4bdcb0aab5b6921ca3ad Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesActionsTest-1594161119 Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:48:37.637830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2153f74cf4b4bdcb0aab5b6921ca3ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2153f74cf4b4bdcb0aab5b6921ca3ad", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2153f74cf4b4bdcb0aab5b6921ca3ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2153f74cf4b4bdcb0aab5b6921ca3ad"}]}] Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesActionsTest-1594161119 Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: b2153f74cf4b4bdcb0aab5b6921ca3ad Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesActionsTest-1594161119 Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesActionsTest-1594161119-project Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: e548ea934bc14b7e921f7e161c5496cf Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesActionsTest-1594161119-project Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: > Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Instance b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 could not be found. Jul 18 16:48:37.641509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'id': 'b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9'} Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 could not be found. Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:48:37.642455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 could not be found. Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 could not be found. Jul 18 16:48:37.643832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:48:37.645410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Returning 404 to user: Instance b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 could not be found. {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:48:37.646542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0b468c62-570a-4d07-ac64-47da6c22c130 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9" status: 404 len: 111 microversion: 2.1 time: 0.085820 Jul 18 16:48:37.660099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 157/310] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:37 2022] GET /compute/v2.1/servers/b83c5f2a-e9ab-4e4a-a7ab-cb4fe9d266e9 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:48:37.769448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1989405664", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "networks": [{"uuid": "da465a9c-ad0b-4855-80f9-49cabf0f047d"}]}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:37.863328 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.network.neutron [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] validate_networks() for [('da465a9c-ad0b-4855-80f9-49cabf0f047d', None, None, None, None, None)] {{(pid=124945) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 16:48:37.954440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-822b507f-9714-48e7-991b-e8018abd5e05 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:37.966447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-822b507f-9714-48e7-991b-e8018abd5e05 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.364659 Jul 18 16:48:37.974747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 154/311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:37 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:38.376590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c5ae347a-f073-4425-8902-0741fd86a3cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:38.379304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c5ae347a-f073-4425-8902-0741fd86a3cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:38.388017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5ae347a-f073-4425-8902-0741fd86a3cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.388883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5ae347a-f073-4425-8902-0741fd86a3cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:38.390123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5ae347a-f073-4425-8902-0741fd86a3cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.391004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5ae347a-f073-4425-8902-0741fd86a3cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:38.589615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c5ae347a-f073-4425-8902-0741fd86a3cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:38.599717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c5ae347a-f073-4425-8902-0741fd86a3cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.227758 Jul 18 16:48:38.601156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 155/312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:38 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:38.700066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Flavor limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 16:48:38.701268 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Image limits 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 16:48:38.701768 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Flavor pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 16:48:38.702189 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Image pref 0:0:0 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 16:48:38.702608 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.virt.hardware [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124945) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 16:48:38.709545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=27 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:38.713641 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.714887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:38.715621 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.716064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:38.735767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Getting quotas for project b2153f74cf4b4bdcb0aab5b6921ca3ad. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 16:48:38.740377 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.quota [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Getting quotas for user e548ea934bc14b7e921f7e161c5496cf and project b2153f74cf4b4bdcb0aab5b6921ca3ad. Resources: {'ram', 'instances', 'cores'} {{(pid=124945) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 16:48:38.768508 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Going to run 1 instances... {{(pid=124945) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 16:48:38.773589 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124945) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 16:48:38.924664 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0712dfd2-e375-4746-aa7b-d034e0bc702d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159039 Jul 18 16:48:38.935525 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 158/313] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 16:48:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 16:48:38.953653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cb0c0bc9-a031-4bec-965a-298c07ab5e2e tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:38.954914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cb0c0bc9-a031-4bec-965a-298c07ab5e2e tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:38.986106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-092ca934-427c-4965-abeb-710b8b3fdc04 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:38.986945 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-092ca934-427c-4965-abeb-710b8b3fdc04 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:38.996231 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-092ca934-427c-4965-abeb-710b8b3fdc04 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.997201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-092ca934-427c-4965-abeb-710b8b3fdc04 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:38.998391 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-092ca934-427c-4965-abeb-710b8b3fdc04 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:38.999087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-092ca934-427c-4965-abeb-710b8b3fdc04 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:39.040036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb0c0bc9-a031-4bec-965a-298c07ab5e2e tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:39.048070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cb0c0bc9-a031-4bec-965a-298c07ab5e2e tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1214 microversion: 2.1 time: 0.112631 Jul 18 16:48:39.048654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 156/314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:38 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:39.193325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-756e8ba8-445f-428b-9fe8-45fe81f1fb5d req-c3647ca4-9ff5-4d4d-8147-6b3d321399dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "295d078f-10f9-4a6d-a3c4-9636ef01a6f7", "tag": "eee981c4-43b3-4282-bd21-b689754ea2dd"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:39.220814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-756e8ba8-445f-428b-9fe8-45fe81f1fb5d req-c3647ca4-9ff5-4d4d-8147-6b3d321399dc service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:39.221917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-756e8ba8-445f-428b-9fe8-45fe81f1fb5d req-c3647ca4-9ff5-4d4d-8147-6b3d321399dc service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:39.239793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-756e8ba8-445f-428b-9fe8-45fe81f1fb5d req-c3647ca4-9ff5-4d4d-8147-6b3d321399dc service nova] Creating event network-changed:eee981c4-43b3-4282-bd21-b689754ea2dd for instance 295d078f-10f9-4a6d-a3c4-9636ef01a6f7 on hv-cinder-84617 Jul 18 16:48:39.241082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-092ca934-427c-4965-abeb-710b8b3fdc04 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:39.244169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-756e8ba8-445f-428b-9fe8-45fe81f1fb5d req-c3647ca4-9ff5-4d4d-8147-6b3d321399dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062032 Jul 18 16:48:39.245965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 157/315] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:48:39.249788 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-092ca934-427c-4965-abeb-710b8b3fdc04 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.268780 Jul 18 16:48:39.253985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 159/316] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:38 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:39.619255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-356c70f3-e240-4c8d-b8d0-7914b9f1b66a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:39.621365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-356c70f3-e240-4c8d-b8d0-7914b9f1b66a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:39.637742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-356c70f3-e240-4c8d-b8d0-7914b9f1b66a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:39.638201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-356c70f3-e240-4c8d-b8d0-7914b9f1b66a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:39.639022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-356c70f3-e240-4c8d-b8d0-7914b9f1b66a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:39.639468 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-356c70f3-e240-4c8d-b8d0-7914b9f1b66a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:39.867355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-356c70f3-e240-4c8d-b8d0-7914b9f1b66a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:39.876966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-356c70f3-e240-4c8d-b8d0-7914b9f1b66a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.260645 Jul 18 16:48:39.876966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 158/317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:39 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:40.023440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-9325e255-ec2f-4a32-889e-44e3887dffbf req-2ed3db33-ad04-4687-86fa-b5f5417ce5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66", "name": "network-vif-plugged", "status": "completed", "tag": "92032a26-dcdf-4f60-ac35-52156a6604c6"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:40.033959 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-9325e255-ec2f-4a32-889e-44e3887dffbf req-2ed3db33-ad04-4687-86fa-b5f5417ce5ef service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.034393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-9325e255-ec2f-4a32-889e-44e3887dffbf req-2ed3db33-ad04-4687-86fa-b5f5417ce5ef service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.047235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-9325e255-ec2f-4a32-889e-44e3887dffbf req-2ed3db33-ad04-4687-86fa-b5f5417ce5ef service nova] Creating event network-vif-plugged:92032a26-dcdf-4f60-ac35-52156a6604c6 for instance 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 on hv-cinder-84617 Jul 18 16:48:40.052368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-9325e255-ec2f-4a32-889e-44e3887dffbf req-2ed3db33-ad04-4687-86fa-b5f5417ce5ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034511 Jul 18 16:48:40.053118 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 160/318] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:40.064797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-21a4fc4d-4545-4a65-97a9-4d2bb80c09ad tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:40.065409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-21a4fc4d-4545-4a65-97a9-4d2bb80c09ad tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:40.071788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-21a4fc4d-4545-4a65-97a9-4d2bb80c09ad tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.072458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-21a4fc4d-4545-4a65-97a9-4d2bb80c09ad tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.074168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-21a4fc4d-4545-4a65-97a9-4d2bb80c09ad tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.074789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-21a4fc4d-4545-4a65-97a9-4d2bb80c09ad tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.143565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-21a4fc4d-4545-4a65-97a9-4d2bb80c09ad tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:40.153558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-21a4fc4d-4545-4a65-97a9-4d2bb80c09ad tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1218 microversion: 2.1 time: 0.092551 Jul 18 16:48:40.154477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 159/319] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:40 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:40.270542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7aa9e295-4a0a-47e0-87e0-ec573b9ae71f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:40.271228 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7aa9e295-4a0a-47e0-87e0-ec573b9ae71f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:40.278351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7aa9e295-4a0a-47e0-87e0-ec573b9ae71f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.278794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7aa9e295-4a0a-47e0-87e0-ec573b9ae71f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.279609 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7aa9e295-4a0a-47e0-87e0-ec573b9ae71f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.280760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7aa9e295-4a0a-47e0-87e0-ec573b9ae71f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.463127 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7aa9e295-4a0a-47e0-87e0-ec573b9ae71f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:40.476154 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7aa9e295-4a0a-47e0-87e0-ec573b9ae71f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.209704 Jul 18 16:48:40.476723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 161/320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:40 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:40.893124 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-936117a9-2725-4325-892b-bc6ef18c531a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:40.893803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-936117a9-2725-4325-892b-bc6ef18c531a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:40.900303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-936117a9-2725-4325-892b-bc6ef18c531a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.900749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-936117a9-2725-4325-892b-bc6ef18c531a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:40.901663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-936117a9-2725-4325-892b-bc6ef18c531a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:40.902122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-936117a9-2725-4325-892b-bc6ef18c531a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:41.040014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-936117a9-2725-4325-892b-bc6ef18c531a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:41.048314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-936117a9-2725-4325-892b-bc6ef18c531a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.159011 Jul 18 16:48:41.048883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 160/321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:40 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:41.171634 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-eac1d88f-73b5-4b36-b98e-d8d6b8e937be tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:41.172234 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-eac1d88f-73b5-4b36-b98e-d8d6b8e937be tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:41.179733 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eac1d88f-73b5-4b36-b98e-d8d6b8e937be tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:41.180421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eac1d88f-73b5-4b36-b98e-d8d6b8e937be tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:41.181212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eac1d88f-73b5-4b36-b98e-d8d6b8e937be tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:41.181640 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eac1d88f-73b5-4b36-b98e-d8d6b8e937be tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:41.246356 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-eac1d88f-73b5-4b36-b98e-d8d6b8e937be tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:41.254220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-eac1d88f-73b5-4b36-b98e-d8d6b8e937be tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1218 microversion: 2.1 time: 0.087194 Jul 18 16:48:41.254783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 162/322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:41 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:41.493643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-253662b9-08a1-4390-b555-808900f9c5fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:41.494380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-253662b9-08a1-4390-b555-808900f9c5fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:41.503691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-253662b9-08a1-4390-b555-808900f9c5fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:41.504386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-253662b9-08a1-4390-b555-808900f9c5fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:41.505295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-253662b9-08a1-4390-b555-808900f9c5fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:41.505799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-253662b9-08a1-4390-b555-808900f9c5fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:41.666713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-253662b9-08a1-4390-b555-808900f9c5fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:41.675697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-253662b9-08a1-4390-b555-808900f9c5fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.186057 Jul 18 16:48:41.676442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 161/323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:41 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:42.066614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-85bb39bf-ee56-436b-be5d-bf5a1070f661 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:42.067224 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-85bb39bf-ee56-436b-be5d-bf5a1070f661 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:42.073290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-85bb39bf-ee56-436b-be5d-bf5a1070f661 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.073752 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-85bb39bf-ee56-436b-be5d-bf5a1070f661 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.074512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-85bb39bf-ee56-436b-be5d-bf5a1070f661 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.076053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-85bb39bf-ee56-436b-be5d-bf5a1070f661 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.213364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-85bb39bf-ee56-436b-be5d-bf5a1070f661 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:42.222290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-85bb39bf-ee56-436b-be5d-bf5a1070f661 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.160860 Jul 18 16:48:42.222861 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 163/324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:42 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:42.270857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-75b87c2b-c34d-4d04-a4d8-42aa744b019b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:42.271599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-75b87c2b-c34d-4d04-a4d8-42aa744b019b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:42.278865 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-75b87c2b-c34d-4d04-a4d8-42aa744b019b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.279302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-75b87c2b-c34d-4d04-a4d8-42aa744b019b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.280143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-75b87c2b-c34d-4d04-a4d8-42aa744b019b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.280572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-75b87c2b-c34d-4d04-a4d8-42aa744b019b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.348632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-75b87c2b-c34d-4d04-a4d8-42aa744b019b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:42.356315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-75b87c2b-c34d-4d04-a4d8-42aa744b019b tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1266 microversion: 2.1 time: 0.089484 Jul 18 16:48:42.356876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 162/325] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:42 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:42.692594 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cec869df-2666-429e-8621-a3ee2fb23466 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:42.693208 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cec869df-2666-429e-8621-a3ee2fb23466 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:42.699153 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cec869df-2666-429e-8621-a3ee2fb23466 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.699637 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cec869df-2666-429e-8621-a3ee2fb23466 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.700401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cec869df-2666-429e-8621-a3ee2fb23466 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:42.700836 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cec869df-2666-429e-8621-a3ee2fb23466 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:42.835011 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cec869df-2666-429e-8621-a3ee2fb23466 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:42.838740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:42.843256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cec869df-2666-429e-8621-a3ee2fb23466 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1369 microversion: 2.1 time: 0.154476 Jul 18 16:48:42.843852 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 164/326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:42 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:43.239832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6393b251-82c2-4b3c-aad0-92a1a7090658 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:43.240350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6393b251-82c2-4b3c-aad0-92a1a7090658 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:43.251822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6393b251-82c2-4b3c-aad0-92a1a7090658 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.252697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6393b251-82c2-4b3c-aad0-92a1a7090658 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.253859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6393b251-82c2-4b3c-aad0-92a1a7090658 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.254345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6393b251-82c2-4b3c-aad0-92a1a7090658 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.373465 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ce8eb091-948a-4c76-bc42-557e1dd4e074 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:43.389147 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ce8eb091-948a-4c76-bc42-557e1dd4e074 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:43.395737 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ce8eb091-948a-4c76-bc42-557e1dd4e074 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.396184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ce8eb091-948a-4c76-bc42-557e1dd4e074 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.396966 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ce8eb091-948a-4c76-bc42-557e1dd4e074 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.397415 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ce8eb091-948a-4c76-bc42-557e1dd4e074 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.412577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6393b251-82c2-4b3c-aad0-92a1a7090658 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:43.421118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6393b251-82c2-4b3c-aad0-92a1a7090658 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.185118 Jul 18 16:48:43.421682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 163/327] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:43 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:43.478909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ce8eb091-948a-4c76-bc42-557e1dd4e074 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:43.486582 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ce8eb091-948a-4c76-bc42-557e1dd4e074 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1284 microversion: 2.1 time: 0.116967 Jul 18 16:48:43.487152 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 165/328] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:43 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:43.860539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c907fa39-c4f9-4c72-a970-f193841aa26b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:43.861048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c907fa39-c4f9-4c72-a970-f193841aa26b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:43.867299 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c907fa39-c4f9-4c72-a970-f193841aa26b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.867790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c907fa39-c4f9-4c72-a970-f193841aa26b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:43.868568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c907fa39-c4f9-4c72-a970-f193841aa26b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:43.869013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c907fa39-c4f9-4c72-a970-f193841aa26b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.011562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c907fa39-c4f9-4c72-a970-f193841aa26b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:44.019902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c907fa39-c4f9-4c72-a970-f193841aa26b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1562 microversion: 2.1 time: 0.163218 Jul 18 16:48:44.020478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 164/329] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:43 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:44.036974 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-98bea58f-0263-49c2-8e42-10ce2e0a359f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:44.037462 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-98bea58f-0263-49c2-8e42-10ce2e0a359f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:44.044181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98bea58f-0263-49c2-8e42-10ce2e0a359f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:44.044631 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98bea58f-0263-49c2-8e42-10ce2e0a359f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.045394 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98bea58f-0263-49c2-8e42-10ce2e0a359f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:44.045827 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98bea58f-0263-49c2-8e42-10ce2e0a359f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.125636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-98bea58f-0263-49c2-8e42-10ce2e0a359f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093052 Jul 18 16:48:44.126215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 166/330] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 18 16:48:44 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:44.447364 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7e22e43f-afe5-4d97-9a4f-a8b7323f439d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:44.448011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7e22e43f-afe5-4d97-9a4f-a8b7323f439d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:44.455239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e22e43f-afe5-4d97-9a4f-a8b7323f439d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:44.455721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e22e43f-afe5-4d97-9a4f-a8b7323f439d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.456497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e22e43f-afe5-4d97-9a4f-a8b7323f439d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:44.456938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e22e43f-afe5-4d97-9a4f-a8b7323f439d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.503985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dda79023-341a-4855-9e46-205ba8c4a767 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:44.504918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dda79023-341a-4855-9e46-205ba8c4a767 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:44.518042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dda79023-341a-4855-9e46-205ba8c4a767 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:44.518574 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dda79023-341a-4855-9e46-205ba8c4a767 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.519550 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dda79023-341a-4855-9e46-205ba8c4a767 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:44.520137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dda79023-341a-4855-9e46-205ba8c4a767 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.647271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7e22e43f-afe5-4d97-9a4f-a8b7323f439d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:44.654141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:44.667812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7e22e43f-afe5-4d97-9a4f-a8b7323f439d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.222405 Jul 18 16:48:44.670692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 165/331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:44 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:44.791864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-0c064702-11f7-4b08-b1a7-e7841e18b0a8 req-f74fea0a-934a-4abb-b583-4446ee636b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295d078f-10f9-4a6d-a3c4-9636ef01a6f7", "name": "network-vif-plugged", "status": "completed", "tag": "eee981c4-43b3-4282-bd21-b689754ea2dd"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:44.801172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-0c064702-11f7-4b08-b1a7-e7841e18b0a8 req-f74fea0a-934a-4abb-b583-4446ee636b36 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:44.801623 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-0c064702-11f7-4b08-b1a7-e7841e18b0a8 req-f74fea0a-934a-4abb-b583-4446ee636b36 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:44.813314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-0c064702-11f7-4b08-b1a7-e7841e18b0a8 req-f74fea0a-934a-4abb-b583-4446ee636b36 service nova] Creating event network-vif-plugged:eee981c4-43b3-4282-bd21-b689754ea2dd for instance 295d078f-10f9-4a6d-a3c4-9636ef01a6f7 on hv-cinder-84617 Jul 18 16:48:44.818256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-0c064702-11f7-4b08-b1a7-e7841e18b0a8 req-f74fea0a-934a-4abb-b583-4446ee636b36 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030601 Jul 18 16:48:44.818857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 166/332] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:44.824375 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dda79023-341a-4855-9e46-205ba8c4a767 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:44.832535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dda79023-341a-4855-9e46-205ba8c4a767 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.332388 Jul 18 16:48:44.833620 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 167/333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:44 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:45.694177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fa3c1bf1-0319-4859-a2fb-1170a8f81740 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:45.694877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fa3c1bf1-0319-4859-a2fb-1170a8f81740 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:45.701993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa3c1bf1-0319-4859-a2fb-1170a8f81740 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:45.702381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa3c1bf1-0319-4859-a2fb-1170a8f81740 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:45.703151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa3c1bf1-0319-4859-a2fb-1170a8f81740 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:45.703870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa3c1bf1-0319-4859-a2fb-1170a8f81740 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:45.808749 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-fd5023ce-a746-4c56-9215-1cd0f5e62687 req-ce6cb61e-e167-44fb-9488-896de92e1de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66", "tag": "92032a26-dcdf-4f60-ac35-52156a6604c6"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:45.818070 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-fd5023ce-a746-4c56-9215-1cd0f5e62687 req-ce6cb61e-e167-44fb-9488-896de92e1de2 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:45.818515 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-fd5023ce-a746-4c56-9215-1cd0f5e62687 req-ce6cb61e-e167-44fb-9488-896de92e1de2 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:45.832091 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-fd5023ce-a746-4c56-9215-1cd0f5e62687 req-ce6cb61e-e167-44fb-9488-896de92e1de2 service nova] Creating event network-changed:92032a26-dcdf-4f60-ac35-52156a6604c6 for instance 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 on hv-cinder-84617 Jul 18 16:48:45.839130 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-fd5023ce-a746-4c56-9215-1cd0f5e62687 req-ce6cb61e-e167-44fb-9488-896de92e1de2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034150 Jul 18 16:48:45.839824 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 168/334] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:48:45.850924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f59b98d2-ae71-48a4-87f8-ed16180fdf7d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:45.851836 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f59b98d2-ae71-48a4-87f8-ed16180fdf7d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:45.855133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fa3c1bf1-0319-4859-a2fb-1170a8f81740 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:45.859739 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f59b98d2-ae71-48a4-87f8-ed16180fdf7d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:45.860193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f59b98d2-ae71-48a4-87f8-ed16180fdf7d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:45.860975 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f59b98d2-ae71-48a4-87f8-ed16180fdf7d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:45.861449 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f59b98d2-ae71-48a4-87f8-ed16180fdf7d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:45.863615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fa3c1bf1-0319-4859-a2fb-1170a8f81740 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.174040 Jul 18 16:48:45.871242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 167/335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:45 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:46.000543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f59b98d2-ae71-48a4-87f8-ed16180fdf7d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:46.008676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f59b98d2-ae71-48a4-87f8-ed16180fdf7d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.162156 Jul 18 16:48:46.009455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 169/336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:45 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:46.882068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3afb62c3-1eae-4487-b256-786165d9bcb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:46.882872 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3afb62c3-1eae-4487-b256-786165d9bcb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:46.891548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3afb62c3-1eae-4487-b256-786165d9bcb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:46.891989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3afb62c3-1eae-4487-b256-786165d9bcb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:46.893012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3afb62c3-1eae-4487-b256-786165d9bcb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:46.893616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3afb62c3-1eae-4487-b256-786165d9bcb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:47.026446 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-46a103b9-a424-4916-9f90-cf521b5b5ff1 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:47.027063 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-46a103b9-a424-4916-9f90-cf521b5b5ff1 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:47.033701 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46a103b9-a424-4916-9f90-cf521b5b5ff1 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:47.034141 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46a103b9-a424-4916-9f90-cf521b5b5ff1 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:47.034944 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46a103b9-a424-4916-9f90-cf521b5b5ff1 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:47.035359 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46a103b9-a424-4916-9f90-cf521b5b5ff1 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:47.037539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3afb62c3-1eae-4487-b256-786165d9bcb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:47.045901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3afb62c3-1eae-4487-b256-786165d9bcb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.167872 Jul 18 16:48:47.046422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 168/337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:46 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:47.248644 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-46a103b9-a424-4916-9f90-cf521b5b5ff1 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:47.258137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-46a103b9-a424-4916-9f90-cf521b5b5ff1 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.235509 Jul 18 16:48:47.259147 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 170/338] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:47 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:47.855974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-769a5397-fb87-4360-8a03-2cc54aeb07bf req-99d6c8a2-dcaf-4695-a1ec-7ee4de6a10d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a1deee-ca16-4733-a70c-0288c30f430c", "tag": "42dfcfd5-84db-49e9-a908-74c8e98a6f77"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:48:47.864789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-769a5397-fb87-4360-8a03-2cc54aeb07bf req-99d6c8a2-dcaf-4695-a1ec-7ee4de6a10d3 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:47.865234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-769a5397-fb87-4360-8a03-2cc54aeb07bf req-99d6c8a2-dcaf-4695-a1ec-7ee4de6a10d3 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:47.877567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-769a5397-fb87-4360-8a03-2cc54aeb07bf req-99d6c8a2-dcaf-4695-a1ec-7ee4de6a10d3 service nova] Creating event network-changed:42dfcfd5-84db-49e9-a908-74c8e98a6f77 for instance 17a1deee-ca16-4733-a70c-0288c30f430c on hv-cinder-84617 Jul 18 16:48:47.883082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-769a5397-fb87-4360-8a03-2cc54aeb07bf req-99d6c8a2-dcaf-4695-a1ec-7ee4de6a10d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030792 Jul 18 16:48:47.884057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 169/339] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:48:48.064396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0daac608-5bb4-4f96-a9d9-571f4533337e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:48.065005 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0daac608-5bb4-4f96-a9d9-571f4533337e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:48.071836 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0daac608-5bb4-4f96-a9d9-571f4533337e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.072333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0daac608-5bb4-4f96-a9d9-571f4533337e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.073107 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0daac608-5bb4-4f96-a9d9-571f4533337e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.073597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0daac608-5bb4-4f96-a9d9-571f4533337e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.210985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0daac608-5bb4-4f96-a9d9-571f4533337e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:48.218524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0daac608-5bb4-4f96-a9d9-571f4533337e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.159771 Jul 18 16:48:48.219079 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 171/340] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:48 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:48.277062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-08a8cb40-3f91-4e02-9328-894e262a45b5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:48.278483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-08a8cb40-3f91-4e02-9328-894e262a45b5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:48.284543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08a8cb40-3f91-4e02-9328-894e262a45b5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.284990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08a8cb40-3f91-4e02-9328-894e262a45b5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.285747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08a8cb40-3f91-4e02-9328-894e262a45b5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:48.286195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08a8cb40-3f91-4e02-9328-894e262a45b5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:48.420743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-08a8cb40-3f91-4e02-9328-894e262a45b5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:48.428349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-08a8cb40-3f91-4e02-9328-894e262a45b5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.155989 Jul 18 16:48:48.428911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 170/341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:48 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:49.235564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e96147c8-3dd0-43ce-a96e-38c26bce43cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:49.236112 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e96147c8-3dd0-43ce-a96e-38c26bce43cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:49.238000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=6 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:49.238688 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:49.243486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e96147c8-3dd0-43ce-a96e-38c26bce43cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:49.243951 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e96147c8-3dd0-43ce-a96e-38c26bce43cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:49.244761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e96147c8-3dd0-43ce-a96e-38c26bce43cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:49.245192 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e96147c8-3dd0-43ce-a96e-38c26bce43cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:49.379718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e96147c8-3dd0-43ce-a96e-38c26bce43cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:49.388022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e96147c8-3dd0-43ce-a96e-38c26bce43cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.155784 Jul 18 16:48:49.388596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 172/342] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:49 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:49.443995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9de392f4-3b80-4c31-b8ed-a551cd9ea4fe tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:49.444600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9de392f4-3b80-4c31-b8ed-a551cd9ea4fe tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:49.446527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=6 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:49.452347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9de392f4-3b80-4c31-b8ed-a551cd9ea4fe tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:49.452788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9de392f4-3b80-4c31-b8ed-a551cd9ea4fe tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:49.453538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9de392f4-3b80-4c31-b8ed-a551cd9ea4fe tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:49.454215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9de392f4-3b80-4c31-b8ed-a551cd9ea4fe tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:49.586021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9de392f4-3b80-4c31-b8ed-a551cd9ea4fe tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:49.593395 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9de392f4-3b80-4c31-b8ed-a551cd9ea4fe tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.153187 Jul 18 16:48:49.593959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 171/343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:49 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:50.407085 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5db7b635-ccdc-4dd1-854c-186742d90654 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:50.407679 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5db7b635-ccdc-4dd1-854c-186742d90654 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:50.409407 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell0:SELECT=5 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:50.414380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5db7b635-ccdc-4dd1-854c-186742d90654 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:50.414823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5db7b635-ccdc-4dd1-854c-186742d90654 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:50.415647 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5db7b635-ccdc-4dd1-854c-186742d90654 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:50.416082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5db7b635-ccdc-4dd1-854c-186742d90654 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:50.547789 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5db7b635-ccdc-4dd1-854c-186742d90654 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:50.555228 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5db7b635-ccdc-4dd1-854c-186742d90654 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.153450 Jul 18 16:48:50.555819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 173/344] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:50 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:50.610307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7e2d3b0c-97ee-4d92-b30b-2a955e282093 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:50.610911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7e2d3b0c-97ee-4d92-b30b-2a955e282093 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:50.617534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e2d3b0c-97ee-4d92-b30b-2a955e282093 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:50.618015 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e2d3b0c-97ee-4d92-b30b-2a955e282093 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:50.618822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e2d3b0c-97ee-4d92-b30b-2a955e282093 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:50.619267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e2d3b0c-97ee-4d92-b30b-2a955e282093 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:50.753081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7e2d3b0c-97ee-4d92-b30b-2a955e282093 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:50.760563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7e2d3b0c-97ee-4d92-b30b-2a955e282093 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.154268 Jul 18 16:48:50.761125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 172/345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:50 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:51.571967 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2d0381b9-82a1-4800-9e72-a2a7f5efac20 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:51.572564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2d0381b9-82a1-4800-9e72-a2a7f5efac20 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:51.579781 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2d0381b9-82a1-4800-9e72-a2a7f5efac20 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.587839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2d0381b9-82a1-4800-9e72-a2a7f5efac20 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.587839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2d0381b9-82a1-4800-9e72-a2a7f5efac20 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.587839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2d0381b9-82a1-4800-9e72-a2a7f5efac20 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.728492 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2d0381b9-82a1-4800-9e72-a2a7f5efac20 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:51.736886 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2d0381b9-82a1-4800-9e72-a2a7f5efac20 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1319 microversion: 2.1 time: 0.168822 Jul 18 16:48:51.737506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 174/346] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:51 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:51.777779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f3604de4-83d9-4136-b102-52098f388eac tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:51.779641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f3604de4-83d9-4136-b102-52098f388eac tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:51.789105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f3604de4-83d9-4136-b102-52098f388eac tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.789972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f3604de4-83d9-4136-b102-52098f388eac tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:51.790906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f3604de4-83d9-4136-b102-52098f388eac tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:51.791417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f3604de4-83d9-4136-b102-52098f388eac tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:52.085307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f3604de4-83d9-4136-b102-52098f388eac tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:52.093900 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f3604de4-83d9-4136-b102-52098f388eac tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.319934 Jul 18 16:48:52.094555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 173/347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:51 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:52.754066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6551153d-57a1-4418-a2b4-2a847ccc94c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:52.754663 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6551153d-57a1-4418-a2b4-2a847ccc94c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:52.760895 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6551153d-57a1-4418-a2b4-2a847ccc94c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:52.761344 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6551153d-57a1-4418-a2b4-2a847ccc94c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:52.762105 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6551153d-57a1-4418-a2b4-2a847ccc94c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:52.762544 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6551153d-57a1-4418-a2b4-2a847ccc94c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:52.927976 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6551153d-57a1-4418-a2b4-2a847ccc94c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:52.936961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6551153d-57a1-4418-a2b4-2a847ccc94c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1509 microversion: 2.1 time: 0.186579 Jul 18 16:48:52.939287 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 175/348] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:52 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:53.111091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e2dc9d53-cdba-4b2c-9ee9-606248e602cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:53.111771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e2dc9d53-cdba-4b2c-9ee9-606248e602cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:53.119004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e2dc9d53-cdba-4b2c-9ee9-606248e602cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:53.119507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e2dc9d53-cdba-4b2c-9ee9-606248e602cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:53.120289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e2dc9d53-cdba-4b2c-9ee9-606248e602cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:53.120735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e2dc9d53-cdba-4b2c-9ee9-606248e602cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:53.319394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e2dc9d53-cdba-4b2c-9ee9-606248e602cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:53.328050 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e2dc9d53-cdba-4b2c-9ee9-606248e602cb tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.221050 Jul 18 16:48:53.328649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 174/349] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:53 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:54.354066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-facfcdf7-981d-4c11-bf82-49f9e9b62804 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:54.354066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-facfcdf7-981d-4c11-bf82-49f9e9b62804 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:54.354066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-facfcdf7-981d-4c11-bf82-49f9e9b62804 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:54.354674 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-facfcdf7-981d-4c11-bf82-49f9e9b62804 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:54.355553 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-facfcdf7-981d-4c11-bf82-49f9e9b62804 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:54.356289 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-facfcdf7-981d-4c11-bf82-49f9e9b62804 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:54.494586 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-facfcdf7-981d-4c11-bf82-49f9e9b62804 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:54.502733 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-facfcdf7-981d-4c11-bf82-49f9e9b62804 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.161048 Jul 18 16:48:54.503295 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 176/350] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:54 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:55.523561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-eafe279b-aa59-4c0f-ac2e-3720dc520d38 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:55.525162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-eafe279b-aa59-4c0f-ac2e-3720dc520d38 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:55.531920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eafe279b-aa59-4c0f-ac2e-3720dc520d38 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:55.532366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eafe279b-aa59-4c0f-ac2e-3720dc520d38 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:55.533177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eafe279b-aa59-4c0f-ac2e-3720dc520d38 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:55.533605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eafe279b-aa59-4c0f-ac2e-3720dc520d38 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:55.671541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-eafe279b-aa59-4c0f-ac2e-3720dc520d38 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:55.679566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-eafe279b-aa59-4c0f-ac2e-3720dc520d38 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.160896 Jul 18 16:48:55.680140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 175/351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:55 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:56.698223 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b8cd682b-cd25-463b-a866-1bb98ffb1985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:56.698908 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b8cd682b-cd25-463b-a866-1bb98ffb1985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:56.707270 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b8cd682b-cd25-463b-a866-1bb98ffb1985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:56.707929 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b8cd682b-cd25-463b-a866-1bb98ffb1985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:56.708737 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b8cd682b-cd25-463b-a866-1bb98ffb1985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:56.709200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b8cd682b-cd25-463b-a866-1bb98ffb1985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:56.900690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b8cd682b-cd25-463b-a866-1bb98ffb1985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:56.910775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b8cd682b-cd25-463b-a866-1bb98ffb1985 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.216280 Jul 18 16:48:56.911417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 177/352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:56 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:48:57.930035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3b7f72ed-859d-4dc4-8ffb-1f2e63f25d1c tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:57.930645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3b7f72ed-859d-4dc4-8ffb-1f2e63f25d1c tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:57.938104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b7f72ed-859d-4dc4-8ffb-1f2e63f25d1c tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:57.938642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b7f72ed-859d-4dc4-8ffb-1f2e63f25d1c tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:57.939519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b7f72ed-859d-4dc4-8ffb-1f2e63f25d1c tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:57.939995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b7f72ed-859d-4dc4-8ffb-1f2e63f25d1c tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:58.085011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3b7f72ed-859d-4dc4-8ffb-1f2e63f25d1c tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:58.093242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3b7f72ed-859d-4dc4-8ffb-1f2e63f25d1c tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.168417 Jul 18 16:48:58.095544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 176/353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:57 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:48:59.109388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-43ec940a-77e9-4466-a53b-3991a22131d8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:48:59.109903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-43ec940a-77e9-4466-a53b-3991a22131d8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:48:59.116115 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-43ec940a-77e9-4466-a53b-3991a22131d8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:59.116561 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-43ec940a-77e9-4466-a53b-3991a22131d8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:59.117329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-43ec940a-77e9-4466-a53b-3991a22131d8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:48:59.117763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-43ec940a-77e9-4466-a53b-3991a22131d8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:48:59.254427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-43ec940a-77e9-4466-a53b-3991a22131d8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:48:59.265065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-43ec940a-77e9-4466-a53b-3991a22131d8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.159579 Jul 18 16:48:59.265662 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 178/354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:48:59 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:49:00.282380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-68e21d3f-4fde-46be-9c48-41275d8ea56f tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:00.282996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-68e21d3f-4fde-46be-9c48-41275d8ea56f tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:00.289844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68e21d3f-4fde-46be-9c48-41275d8ea56f tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:00.290301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68e21d3f-4fde-46be-9c48-41275d8ea56f tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:00.291071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68e21d3f-4fde-46be-9c48-41275d8ea56f tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:00.291514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68e21d3f-4fde-46be-9c48-41275d8ea56f tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:00.434236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-68e21d3f-4fde-46be-9c48-41275d8ea56f tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:00.442881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-68e21d3f-4fde-46be-9c48-41275d8ea56f tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.165459 Jul 18 16:49:00.443455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 177/355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:00 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:00.583601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-160ee3a9-c126-48cc-ab6e-695c7984b856 req-5e6e6030-9364-465e-9414-953776f4baae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a1deee-ca16-4733-a70c-0288c30f430c", "name": "network-vif-plugged", "status": "completed", "tag": "42dfcfd5-84db-49e9-a908-74c8e98a6f77"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:00.593636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-160ee3a9-c126-48cc-ab6e-695c7984b856 req-5e6e6030-9364-465e-9414-953776f4baae service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:00.595464 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-160ee3a9-c126-48cc-ab6e-695c7984b856 req-5e6e6030-9364-465e-9414-953776f4baae service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:00.606270 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-160ee3a9-c126-48cc-ab6e-695c7984b856 req-5e6e6030-9364-465e-9414-953776f4baae service nova] Creating event network-vif-plugged:42dfcfd5-84db-49e9-a908-74c8e98a6f77 for instance 17a1deee-ca16-4733-a70c-0288c30f430c on hv-cinder-84617 Jul 18 16:49:00.611848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-160ee3a9-c126-48cc-ab6e-695c7984b856 req-5e6e6030-9364-465e-9414-953776f4baae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032288 Jul 18 16:49:00.612457 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 179/356] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:01.460548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4d03788a-149c-4fff-90ee-b7e645e91aaf tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:01.461099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4d03788a-149c-4fff-90ee-b7e645e91aaf tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:01.467982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d03788a-149c-4fff-90ee-b7e645e91aaf tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:01.468436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d03788a-149c-4fff-90ee-b7e645e91aaf tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:01.469288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d03788a-149c-4fff-90ee-b7e645e91aaf tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:01.469733 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d03788a-149c-4fff-90ee-b7e645e91aaf tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:01.610150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4d03788a-149c-4fff-90ee-b7e645e91aaf tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:01.617891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4d03788a-149c-4fff-90ee-b7e645e91aaf tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.161286 Jul 18 16:49:01.618572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 178/357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:01 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:02.637225 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4b623788-3ed0-4d7d-850c-408db788a433 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:02.638061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4b623788-3ed0-4d7d-850c-408db788a433 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:02.645428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4b623788-3ed0-4d7d-850c-408db788a433 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:02.650532 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4b623788-3ed0-4d7d-850c-408db788a433 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:02.650532 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4b623788-3ed0-4d7d-850c-408db788a433 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:02.650532 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4b623788-3ed0-4d7d-850c-408db788a433 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:02.805982 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4b623788-3ed0-4d7d-850c-408db788a433 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:02.820492 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4b623788-3ed0-4d7d-850c-408db788a433 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1314 microversion: 2.1 time: 0.185648 Jul 18 16:49:02.830776 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 180/358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:02 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:03.842573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bf35cca7-d4c8-4ac2-bfcc-a8f99d4a7986 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:03.843272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bf35cca7-d4c8-4ac2-bfcc-a8f99d4a7986 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:03.850649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf35cca7-d4c8-4ac2-bfcc-a8f99d4a7986 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:03.851449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf35cca7-d4c8-4ac2-bfcc-a8f99d4a7986 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:03.852848 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf35cca7-d4c8-4ac2-bfcc-a8f99d4a7986 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:03.852848 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf35cca7-d4c8-4ac2-bfcc-a8f99d4a7986 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:04.006652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bf35cca7-d4c8-4ac2-bfcc-a8f99d4a7986 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:04.015247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bf35cca7-d4c8-4ac2-bfcc-a8f99d4a7986 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1498 microversion: 2.1 time: 0.176549 Jul 18 16:49:04.015863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 179/359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:03 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:05.032862 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-46d8ceb5-38e8-409a-b6f6-820e88f66cb8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:05.034442 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-46d8ceb5-38e8-409a-b6f6-820e88f66cb8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:05.046734 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46d8ceb5-38e8-409a-b6f6-820e88f66cb8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:05.047284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46d8ceb5-38e8-409a-b6f6-820e88f66cb8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:05.048161 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46d8ceb5-38e8-409a-b6f6-820e88f66cb8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:05.048599 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46d8ceb5-38e8-409a-b6f6-820e88f66cb8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:05.073956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-46d8ceb5-38e8-409a-b6f6-820e88f66cb8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Going to try to terminate instance {{(pid=124945) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:49:05.210185 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:05.424638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-46d8ceb5-38e8-409a-b6f6-820e88f66cb8 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "DELETE /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 204 len: 0 microversion: 2.1 time: 0.397933 Jul 18 16:49:05.425511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 181/360] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 16:49:05 2022] DELETE /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:49:05.434764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-12ba1d6c-f9af-4803-a3ba-d2d061f56ae6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:05.435385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-12ba1d6c-f9af-4803-a3ba-d2d061f56ae6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:05.439020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=76 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:05.442752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12ba1d6c-f9af-4803-a3ba-d2d061f56ae6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:05.443238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12ba1d6c-f9af-4803-a3ba-d2d061f56ae6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:05.444043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12ba1d6c-f9af-4803-a3ba-d2d061f56ae6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:05.444592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12ba1d6c-f9af-4803-a3ba-d2d061f56ae6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:05.580385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-12ba1d6c-f9af-4803-a3ba-d2d061f56ae6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:05.588162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-12ba1d6c-f9af-4803-a3ba-d2d061f56ae6 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1504 microversion: 2.1 time: 0.157199 Jul 18 16:49:05.588717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 180/361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:05 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:06.605800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-893c7be5-15b6-4fc4-96f0-ce697521343d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:06.606480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-893c7be5-15b6-4fc4-96f0-ce697521343d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:06.612810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-893c7be5-15b6-4fc4-96f0-ce697521343d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:06.613246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-893c7be5-15b6-4fc4-96f0-ce697521343d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:06.614002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-893c7be5-15b6-4fc4-96f0-ce697521343d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:06.614424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-893c7be5-15b6-4fc4-96f0-ce697521343d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:06.752917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-893c7be5-15b6-4fc4-96f0-ce697521343d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:06.760558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-893c7be5-15b6-4fc4-96f0-ce697521343d tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1504 microversion: 2.1 time: 0.159087 Jul 18 16:49:06.761112 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 182/362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:06 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:07.784150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dbba5564-fb83-49e7-8d04-6857e4de11c5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:07.785467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-dbba5564-fb83-49e7-8d04-6857e4de11c5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:07.797576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbba5564-fb83-49e7-8d04-6857e4de11c5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:07.801680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbba5564-fb83-49e7-8d04-6857e4de11c5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:07.801680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbba5564-fb83-49e7-8d04-6857e4de11c5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:07.801680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbba5564-fb83-49e7-8d04-6857e4de11c5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:08.021307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-dbba5564-fb83-49e7-8d04-6857e4de11c5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:08.029411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dbba5564-fb83-49e7-8d04-6857e4de11c5 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1504 microversion: 2.1 time: 0.253924 Jul 18 16:49:08.030133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 181/363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:07 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:08.290430 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-809917d6-6e04-434f-8e17-03ed3702d486 req-ed787a8f-bfa1-4378-b9a4-46239c8a1cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a1deee-ca16-4733-a70c-0288c30f430c", "name": "network-vif-deleted", "tag": "42dfcfd5-84db-49e9-a908-74c8e98a6f77"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:08.300025 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-809917d6-6e04-434f-8e17-03ed3702d486 req-ed787a8f-bfa1-4378-b9a4-46239c8a1cc1 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:08.300628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-809917d6-6e04-434f-8e17-03ed3702d486 req-ed787a8f-bfa1-4378-b9a4-46239c8a1cc1 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:08.315384 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-809917d6-6e04-434f-8e17-03ed3702d486 req-ed787a8f-bfa1-4378-b9a4-46239c8a1cc1 service nova] Creating event network-vif-deleted:42dfcfd5-84db-49e9-a908-74c8e98a6f77 for instance 17a1deee-ca16-4733-a70c-0288c30f430c on hv-cinder-84617 Jul 18 16:49:08.320562 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-809917d6-6e04-434f-8e17-03ed3702d486 req-ed787a8f-bfa1-4378-b9a4-46239c8a1cc1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034029 Jul 18 16:49:08.328186 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 183/364] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:09.046655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:09.047252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:09.053788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:09.054303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:09.055049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:09.055486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:09.089779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:09.090147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:09.090596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lazy-loading 'fault' on Instance uuid 17a1deee-ca16-4733-a70c-0288c30f430c {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:49:09.137571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e548ea934bc14b7e921f7e161c5496cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2153f74cf4b4bdcb0aab5b6921ca3ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:49:09.145076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ea93154a-88f8-4fa5-bfbd-c7d3c4b852c9 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 200 len: 1304 microversion: 2.1 time: 0.102304 Jul 18 16:49:09.145659 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 182/365] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:09 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:49:10.167296 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:10.168021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] [instance: 17a1deee-ca16-4733-a70c-0288c30f430c] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:10.174416 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:10.174864 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:10.175675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:10.176115 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:10.190301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] HTTP exception thrown: Instance 17a1deee-ca16-4733-a70c-0288c30f430c could not be found. Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Request method failure captured: Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c HTTP/1.1 Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y7Ja1N0sF8vxclxVMGfwVJrh35eTT-lDJnLUy_UClcpsq241rwCOTv4OdZlsbe-YMYYc0c5Id3HNu0fO8rOhfRVlg1u8HHU8tD5Qvvyh--jif9it6FrWISmbk9GuU3n3td7IQxzRCOmQ86-UDH3fSuebWsWdAVh9dLEp1ctT6MWut0 Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: b2153f74cf4b4bdcb0aab5b6921ca3ad Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesActionsTest-1594161119 Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:49:10.192007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2153f74cf4b4bdcb0aab5b6921ca3ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2153f74cf4b4bdcb0aab5b6921ca3ad", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2153f74cf4b4bdcb0aab5b6921ca3ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2153f74cf4b4bdcb0aab5b6921ca3ad"}]}] Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesActionsTest-1594161119 Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: b2153f74cf4b4bdcb0aab5b6921ca3ad Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesActionsTest-1594161119 Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesActionsTest-1594161119-project Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: e548ea934bc14b7e921f7e161c5496cf Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesActionsTest-1594161119-project Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: > Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Instance 17a1deee-ca16-4733-a70c-0288c30f430c could not be found. Jul 18 16:49:10.193587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'id': '17a1deee-ca16-4733-a70c-0288c30f430c'} Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a1deee-ca16-4733-a70c-0288c30f430c could not be found. Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:49:10.194657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a1deee-ca16-4733-a70c-0288c30f430c could not be found. Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a1deee-ca16-4733-a70c-0288c30f430c could not be found. Jul 18 16:49:10.195955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:49:10.197002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] Returning 404 to user: Instance 17a1deee-ca16-4733-a70c-0288c30f430c could not be found. {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:49:10.197002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e6ee5899-c6e7-4953-b72b-8e555e7965a3 tempest-VolumesActionsTest-1594161119 tempest-VolumesActionsTest-1594161119-project] 10.222.0.26 "GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c" status: 404 len: 111 microversion: 2.1 time: 0.030318 Jul 18 16:49:10.197002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 184/366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:49:10 2022] GET /compute/v2.1/servers/17a1deee-ca16-4733-a70c-0288c30f430c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 16:49:21.327796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0666623b-3135-4ed9-b2a2-a2e8983111f2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a466a22-b3b1-4b8f-81fc-a96e25284358", "device": "/dev/sdb"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:21.330452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0666623b-3135-4ed9-b2a2-a2e8983111f2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:21.334940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=7 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:21.335967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=96 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:21.340267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0666623b-3135-4ed9-b2a2-a2e8983111f2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:21.345027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0666623b-3135-4ed9-b2a2-a2e8983111f2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:21.349200 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0666623b-3135-4ed9-b2a2-a2e8983111f2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:21.349200 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0666623b-3135-4ed9-b2a2-a2e8983111f2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:22.293828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0666623b-3135-4ed9-b2a2-a2e8983111f2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "POST /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.970747 Jul 18 16:49:22.303362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 183/367] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 16:49:21 2022] POST /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments => generated 194 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:49:29.891434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:49:29.893375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 16:49:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:49:35.290992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2122308c-44a9-48bf-9f7b-f54c59f312ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:49:35.291754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2122308c-44a9-48bf-9f7b-f54c59f312ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:35.293764 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:35.294506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:35.299588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2122308c-44a9-48bf-9f7b-f54c59f312ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:35.300329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2122308c-44a9-48bf-9f7b-f54c59f312ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:35.301362 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2122308c-44a9-48bf-9f7b-f54c59f312ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:35.301919 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2122308c-44a9-48bf-9f7b-f54c59f312ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:35.450379 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.objects.instance [None req-2122308c-44a9-48bf-9f7b-f54c59f312ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lazy-loading 'services' on Instance uuid 7dee0085-26fb-4535-8630-6f96f19445f5 {{(pid=124945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:49:35.737850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2122308c-44a9-48bf-9f7b-f54c59f312ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments/bb7aa4fe-c42e-47b4-bad6-add28b0d5f8c" status: 202 len: 0 microversion: 2.1 time: 0.450696 Jul 18 16:49:35.738468 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 185/368] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 16:49:35 2022] DELETE /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments/bb7aa4fe-c42e-47b4-bad6-add28b0d5f8c => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:49:50.751787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:50.752830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:50.758167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8bca6a1b-47e2-40d6-8df3-323dad45ee53 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66cfbb49-b48e-4973-861b-9edbc4febd6e"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:49:50.759315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8bca6a1b-47e2-40d6-8df3-323dad45ee53 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:49:50.766632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bca6a1b-47e2-40d6-8df3-323dad45ee53 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:50.767201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bca6a1b-47e2-40d6-8df3-323dad45ee53 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:49:50.768011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bca6a1b-47e2-40d6-8df3-323dad45ee53 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:49:50.768383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bca6a1b-47e2-40d6-8df3-323dad45ee53 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:50:00.820810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:00.940108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=6 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:50:25.806446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:50:25.807124 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 16:50:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66/os-volume_attachments (ip 10.222.0.26) !!! Jul 18 16:50:26.935379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8bca6a1b-47e2-40d6-8df3-323dad45ee53 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "POST /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 36.184815 Jul 18 16:50:26.936454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 184/369] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 16:49:50 2022] POST /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66/os-volume_attachments => generated 194 bytes in 36187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:50:54.299111 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:50:54.299880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 16:50:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:51:06.500126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:51:06.500827 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 16:51:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:51:06.941724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=2 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:06.942610 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:06.950058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-39651885-b404-431a-a7ff-326b94103a7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:06.956970 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-39651885-b404-431a-a7ff-326b94103a7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:06.958375 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-39651885-b404-431a-a7ff-326b94103a7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:06.958821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-39651885-b404-431a-a7ff-326b94103a7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:06.959785 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-39651885-b404-431a-a7ff-326b94103a7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:06.960716 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-39651885-b404-431a-a7ff-326b94103a7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:06.984764 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.objects.instance [None req-39651885-b404-431a-a7ff-326b94103a7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lazy-loading 'flavor' on Instance uuid 6f1c9245-f7e5-4ff8-b561-7dc29e139931 {{(pid=124945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:51:07.402034 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-39651885-b404-431a-a7ff-326b94103a7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "POST /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931/action" status: 202 len: 0 microversion: 2.1 time: 0.461684 Jul 18 16:51:07.402625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 186/370] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 16:51:06 2022] POST /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:51:07.409625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:07.414833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6d264433-5492-4d80-a020-fb67dc47ba48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:07.415971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6d264433-5492-4d80-a020-fb67dc47ba48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:07.422702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6d264433-5492-4d80-a020-fb67dc47ba48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.423144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6d264433-5492-4d80-a020-fb67dc47ba48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.423952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6d264433-5492-4d80-a020-fb67dc47ba48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:07.424387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6d264433-5492-4d80-a020-fb67dc47ba48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:07.767807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6d264433-5492-4d80-a020-fb67dc47ba48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:07.779070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6d264433-5492-4d80-a020-fb67dc47ba48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.371534 Jul 18 16:51:07.779665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 185/371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:08.797380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5d60f015-155a-44fe-b69f-b740168b86a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:08.798064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5d60f015-155a-44fe-b69f-b740168b86a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:08.805080 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d60f015-155a-44fe-b69f-b740168b86a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:08.805519 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d60f015-155a-44fe-b69f-b740168b86a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:08.806303 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d60f015-155a-44fe-b69f-b740168b86a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:08.806731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d60f015-155a-44fe-b69f-b740168b86a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:09.038312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5d60f015-155a-44fe-b69f-b740168b86a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:09.047107 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5d60f015-155a-44fe-b69f-b740168b86a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.254032 Jul 18 16:51:09.047725 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 187/372] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:08 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:10.070780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c6078dec-2065-4f80-b5ae-9ff409fb7c57 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:10.071520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c6078dec-2065-4f80-b5ae-9ff409fb7c57 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:10.078695 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c6078dec-2065-4f80-b5ae-9ff409fb7c57 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:10.079143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c6078dec-2065-4f80-b5ae-9ff409fb7c57 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:10.079967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c6078dec-2065-4f80-b5ae-9ff409fb7c57 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:10.080405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c6078dec-2065-4f80-b5ae-9ff409fb7c57 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:10.236240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c6078dec-2065-4f80-b5ae-9ff409fb7c57 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:10.245435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c6078dec-2065-4f80-b5ae-9ff409fb7c57 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.178923 Jul 18 16:51:10.246631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 186/373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:10 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:11.266105 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bcc13ac8-019e-43b8-8ba9-e593204376f5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:11.267151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bcc13ac8-019e-43b8-8ba9-e593204376f5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:11.275615 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bcc13ac8-019e-43b8-8ba9-e593204376f5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:11.276061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bcc13ac8-019e-43b8-8ba9-e593204376f5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:11.276836 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bcc13ac8-019e-43b8-8ba9-e593204376f5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:11.277274 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bcc13ac8-019e-43b8-8ba9-e593204376f5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:11.436686 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bcc13ac8-019e-43b8-8ba9-e593204376f5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:11.445130 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bcc13ac8-019e-43b8-8ba9-e593204376f5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.184830 Jul 18 16:51:11.445723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 188/374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:11 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:12.463054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fe9084ce-d004-47bd-bef2-70b685ac7cee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:12.463703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fe9084ce-d004-47bd-bef2-70b685ac7cee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:12.470843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe9084ce-d004-47bd-bef2-70b685ac7cee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:12.471283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe9084ce-d004-47bd-bef2-70b685ac7cee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:12.472116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe9084ce-d004-47bd-bef2-70b685ac7cee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:12.472554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe9084ce-d004-47bd-bef2-70b685ac7cee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:12.637001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe9084ce-d004-47bd-bef2-70b685ac7cee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:12.645074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fe9084ce-d004-47bd-bef2-70b685ac7cee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.186172 Jul 18 16:51:12.645669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 187/375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:12 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:13.668102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3d3c8b17-f583-4f11-8526-2b25286f942e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:13.669183 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3d3c8b17-f583-4f11-8526-2b25286f942e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:13.681049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d3c8b17-f583-4f11-8526-2b25286f942e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:13.681807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d3c8b17-f583-4f11-8526-2b25286f942e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:13.683226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d3c8b17-f583-4f11-8526-2b25286f942e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:13.684023 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d3c8b17-f583-4f11-8526-2b25286f942e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:13.872951 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3d3c8b17-f583-4f11-8526-2b25286f942e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:13.882066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3d3c8b17-f583-4f11-8526-2b25286f942e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.221915 Jul 18 16:51:13.882644 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 189/376] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:13 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:14.910323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-14a99d0c-f276-4dd7-acb8-5e54362055f1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:14.911773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-14a99d0c-f276-4dd7-acb8-5e54362055f1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:14.919272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14a99d0c-f276-4dd7-acb8-5e54362055f1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:14.919756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14a99d0c-f276-4dd7-acb8-5e54362055f1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:14.920524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14a99d0c-f276-4dd7-acb8-5e54362055f1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:14.920982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14a99d0c-f276-4dd7-acb8-5e54362055f1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:15.079141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-14a99d0c-f276-4dd7-acb8-5e54362055f1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:15.089523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-14a99d0c-f276-4dd7-acb8-5e54362055f1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.182956 Jul 18 16:51:15.090384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 188/377] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:14 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:16.116393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dc8a16fb-a0bf-4e60-8a64-fd8ba235fa8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:16.117063 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dc8a16fb-a0bf-4e60-8a64-fd8ba235fa8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:16.124196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc8a16fb-a0bf-4e60-8a64-fd8ba235fa8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:16.124763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc8a16fb-a0bf-4e60-8a64-fd8ba235fa8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:16.125895 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc8a16fb-a0bf-4e60-8a64-fd8ba235fa8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:16.126244 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc8a16fb-a0bf-4e60-8a64-fd8ba235fa8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:16.342429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dc8a16fb-a0bf-4e60-8a64-fd8ba235fa8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:16.356634 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dc8a16fb-a0bf-4e60-8a64-fd8ba235fa8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.244256 Jul 18 16:51:16.357718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 190/378] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:16 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:17.388605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a7e4f0e5-7c1e-4dab-8858-1d82d843e950 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:17.389205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a7e4f0e5-7c1e-4dab-8858-1d82d843e950 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:17.397150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7e4f0e5-7c1e-4dab-8858-1d82d843e950 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:17.397686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7e4f0e5-7c1e-4dab-8858-1d82d843e950 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:17.398666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7e4f0e5-7c1e-4dab-8858-1d82d843e950 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:17.399247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7e4f0e5-7c1e-4dab-8858-1d82d843e950 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:17.593436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a7e4f0e5-7c1e-4dab-8858-1d82d843e950 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:17.602625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a7e4f0e5-7c1e-4dab-8858-1d82d843e950 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.217870 Jul 18 16:51:17.603220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 189/379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:17 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:18.621787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-158a5d1c-5c43-4a0c-9884-ac3088244e3f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:18.622434 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-158a5d1c-5c43-4a0c-9884-ac3088244e3f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:18.628893 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-158a5d1c-5c43-4a0c-9884-ac3088244e3f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:18.630188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-158a5d1c-5c43-4a0c-9884-ac3088244e3f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:18.631161 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-158a5d1c-5c43-4a0c-9884-ac3088244e3f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:18.631663 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-158a5d1c-5c43-4a0c-9884-ac3088244e3f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:18.794643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-158a5d1c-5c43-4a0c-9884-ac3088244e3f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:18.803367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-158a5d1c-5c43-4a0c-9884-ac3088244e3f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.185450 Jul 18 16:51:18.803998 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 191/380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:18 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:19.821770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9d559f6b-ef93-4c65-b737-30a8647cede0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:19.822420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9d559f6b-ef93-4c65-b737-30a8647cede0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:19.833757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d559f6b-ef93-4c65-b737-30a8647cede0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:19.833757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d559f6b-ef93-4c65-b737-30a8647cede0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:19.834879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d559f6b-ef93-4c65-b737-30a8647cede0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:19.835647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d559f6b-ef93-4c65-b737-30a8647cede0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:20.017721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9d559f6b-ef93-4c65-b737-30a8647cede0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:20.029287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9d559f6b-ef93-4c65-b737-30a8647cede0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.211634 Jul 18 16:51:20.037126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 190/381] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:19 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:21.050747 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cbe7f5a9-f531-4a03-9808-908a8dbdade1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:21.051456 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cbe7f5a9-f531-4a03-9808-908a8dbdade1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:21.058583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbe7f5a9-f531-4a03-9808-908a8dbdade1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:21.059102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbe7f5a9-f531-4a03-9808-908a8dbdade1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:21.062044 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbe7f5a9-f531-4a03-9808-908a8dbdade1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:21.062494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbe7f5a9-f531-4a03-9808-908a8dbdade1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:21.215973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cbe7f5a9-f531-4a03-9808-908a8dbdade1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:21.224469 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cbe7f5a9-f531-4a03-9808-908a8dbdade1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.177912 Jul 18 16:51:21.225066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 192/382] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:22.243421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0b635716-83b9-46d7-a87f-387e310316e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:22.244057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0b635716-83b9-46d7-a87f-387e310316e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:22.250960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b635716-83b9-46d7-a87f-387e310316e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:22.251402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b635716-83b9-46d7-a87f-387e310316e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:22.252205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b635716-83b9-46d7-a87f-387e310316e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:22.252632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b635716-83b9-46d7-a87f-387e310316e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:22.411905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0b635716-83b9-46d7-a87f-387e310316e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:22.421129 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0b635716-83b9-46d7-a87f-387e310316e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.182041 Jul 18 16:51:22.421788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 191/383] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:23.439680 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6e3e0f84-1811-4bf1-8a65-8605803d5ff0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:23.441015 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6e3e0f84-1811-4bf1-8a65-8605803d5ff0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:23.447250 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f84-1811-4bf1-8a65-8605803d5ff0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:23.447721 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f84-1811-4bf1-8a65-8605803d5ff0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:23.448516 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f84-1811-4bf1-8a65-8605803d5ff0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:23.448948 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e3e0f84-1811-4bf1-8a65-8605803d5ff0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:23.615967 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6e3e0f84-1811-4bf1-8a65-8605803d5ff0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:23.630107 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6e3e0f84-1811-4bf1-8a65-8605803d5ff0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.194214 Jul 18 16:51:23.631162 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 193/384] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:24.655723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ea9bf587-4740-40b7-b7dc-4d79b19e0f23 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:24.656367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ea9bf587-4740-40b7-b7dc-4d79b19e0f23 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:24.665480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea9bf587-4740-40b7-b7dc-4d79b19e0f23 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:24.665973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea9bf587-4740-40b7-b7dc-4d79b19e0f23 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:24.666800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea9bf587-4740-40b7-b7dc-4d79b19e0f23 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:24.667375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea9bf587-4740-40b7-b7dc-4d79b19e0f23 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:24.829916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea9bf587-4740-40b7-b7dc-4d79b19e0f23 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:24.842388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ea9bf587-4740-40b7-b7dc-4d79b19e0f23 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.190351 Jul 18 16:51:24.843480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 192/385] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:24 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:25.321634 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-40d6f71a-76d8-435f-8b26-0e0a181bf63f req-f96e9b6a-ca96-4ac0-8407-571fbde59d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1c9245-f7e5-4ff8-b561-7dc29e139931", "name": "network-vif-unplugged", "status": "completed", "tag": "58e840d1-84ce-4ac8-bb93-2ee5a430d89d"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:51:25.331240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-40d6f71a-76d8-435f-8b26-0e0a181bf63f req-f96e9b6a-ca96-4ac0-8407-571fbde59d75 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:25.331984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-40d6f71a-76d8-435f-8b26-0e0a181bf63f req-f96e9b6a-ca96-4ac0-8407-571fbde59d75 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:25.345396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-40d6f71a-76d8-435f-8b26-0e0a181bf63f req-f96e9b6a-ca96-4ac0-8407-571fbde59d75 service nova] Creating event network-vif-unplugged:58e840d1-84ce-4ac8-bb93-2ee5a430d89d for instance 6f1c9245-f7e5-4ff8-b561-7dc29e139931 on hv-cinder-84617 Jul 18 16:51:25.352179 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-40d6f71a-76d8-435f-8b26-0e0a181bf63f req-f96e9b6a-ca96-4ac0-8407-571fbde59d75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107487 Jul 18 16:51:25.352841 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 194/386] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:51:25.862355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-05e43c84-47ba-4f4c-8c4c-15dc70bac110 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:25.863303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-05e43c84-47ba-4f4c-8c4c-15dc70bac110 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:25.870709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-05e43c84-47ba-4f4c-8c4c-15dc70bac110 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:25.871201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-05e43c84-47ba-4f4c-8c4c-15dc70bac110 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:25.872087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-05e43c84-47ba-4f4c-8c4c-15dc70bac110 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:25.872656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-05e43c84-47ba-4f4c-8c4c-15dc70bac110 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:26.028150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-05e43c84-47ba-4f4c-8c4c-15dc70bac110 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:26.038308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-05e43c84-47ba-4f4c-8c4c-15dc70bac110 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.180190 Jul 18 16:51:26.039096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 193/387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:27.057312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c8f2215b-4ceb-4660-b7ca-cd5e5c0f06e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:27.058030 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c8f2215b-4ceb-4660-b7ca-cd5e5c0f06e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:27.065366 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8f2215b-4ceb-4660-b7ca-cd5e5c0f06e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:27.066092 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8f2215b-4ceb-4660-b7ca-cd5e5c0f06e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:27.067142 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8f2215b-4ceb-4660-b7ca-cd5e5c0f06e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:27.067630 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8f2215b-4ceb-4660-b7ca-cd5e5c0f06e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:27.232534 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c8f2215b-4ceb-4660-b7ca-cd5e5c0f06e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:27.241339 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c8f2215b-4ceb-4660-b7ca-cd5e5c0f06e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.188417 Jul 18 16:51:27.241965 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 195/388] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:28.263321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5fc848fc-65c1-4408-860c-2c7f434ff43f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:28.264446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5fc848fc-65c1-4408-860c-2c7f434ff43f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:28.277526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5fc848fc-65c1-4408-860c-2c7f434ff43f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:28.278308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5fc848fc-65c1-4408-860c-2c7f434ff43f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:28.279926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5fc848fc-65c1-4408-860c-2c7f434ff43f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:28.280676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5fc848fc-65c1-4408-860c-2c7f434ff43f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:28.468806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5fc848fc-65c1-4408-860c-2c7f434ff43f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:28.483685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5fc848fc-65c1-4408-860c-2c7f434ff43f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.227489 Jul 18 16:51:28.486006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 194/389] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:28 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:29.502502 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-98db4d5c-e58b-4c25-a6ba-421bb6b5b7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:29.503335 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-98db4d5c-e58b-4c25-a6ba-421bb6b5b7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:29.509913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98db4d5c-e58b-4c25-a6ba-421bb6b5b7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:29.510485 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98db4d5c-e58b-4c25-a6ba-421bb6b5b7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:29.511580 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98db4d5c-e58b-4c25-a6ba-421bb6b5b7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:29.512137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98db4d5c-e58b-4c25-a6ba-421bb6b5b7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:29.663744 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-98db4d5c-e58b-4c25-a6ba-421bb6b5b7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:29.672060 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-98db4d5c-e58b-4c25-a6ba-421bb6b5b7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.173589 Jul 18 16:51:29.672730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 196/390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:29 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:30.690315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ec9a33de-f5e4-4ca2-b857-525112a00785 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:30.691066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ec9a33de-f5e4-4ca2-b857-525112a00785 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:30.698535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec9a33de-f5e4-4ca2-b857-525112a00785 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:30.699044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec9a33de-f5e4-4ca2-b857-525112a00785 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:30.699982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec9a33de-f5e4-4ca2-b857-525112a00785 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:30.700468 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec9a33de-f5e4-4ca2-b857-525112a00785 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:30.872690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ec9a33de-f5e4-4ca2-b857-525112a00785 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:30.881519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ec9a33de-f5e4-4ca2-b857-525112a00785 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.195181 Jul 18 16:51:30.882115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 195/391] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:30 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:31.899242 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-abcf11b4-52f3-46b2-bc49-537da4967e7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:31.899927 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-abcf11b4-52f3-46b2-bc49-537da4967e7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:31.906513 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-abcf11b4-52f3-46b2-bc49-537da4967e7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:31.906952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-abcf11b4-52f3-46b2-bc49-537da4967e7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:31.909161 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-abcf11b4-52f3-46b2-bc49-537da4967e7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:31.909612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-abcf11b4-52f3-46b2-bc49-537da4967e7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:32.066210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-abcf11b4-52f3-46b2-bc49-537da4967e7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:32.074888 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-abcf11b4-52f3-46b2-bc49-537da4967e7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.179479 Jul 18 16:51:32.075517 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 197/392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:31 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:33.093712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d9a68930-7b3d-42a8-a68c-85661c9d9d51 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:33.094323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d9a68930-7b3d-42a8-a68c-85661c9d9d51 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:33.101612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9a68930-7b3d-42a8-a68c-85661c9d9d51 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:33.102064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9a68930-7b3d-42a8-a68c-85661c9d9d51 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:33.102862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9a68930-7b3d-42a8-a68c-85661c9d9d51 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:33.103305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9a68930-7b3d-42a8-a68c-85661c9d9d51 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:33.262098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d9a68930-7b3d-42a8-a68c-85661c9d9d51 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:33.277129 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d9a68930-7b3d-42a8-a68c-85661c9d9d51 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.187219 Jul 18 16:51:33.278167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 196/393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:34.299234 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-fb8c7d96-35ac-4cbb-b546-88211f77659e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:34.300753 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-fb8c7d96-35ac-4cbb-b546-88211f77659e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:34.308866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb8c7d96-35ac-4cbb-b546-88211f77659e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:34.309649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb8c7d96-35ac-4cbb-b546-88211f77659e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:34.310603 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb8c7d96-35ac-4cbb-b546-88211f77659e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:34.311166 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb8c7d96-35ac-4cbb-b546-88211f77659e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:34.471876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-fb8c7d96-35ac-4cbb-b546-88211f77659e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:34.480292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-fb8c7d96-35ac-4cbb-b546-88211f77659e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.186719 Jul 18 16:51:34.480883 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 198/394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:34 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:35.503745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4b6d8f0d-824d-44c8-919e-ff2826fc8d78 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:35.505160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4b6d8f0d-824d-44c8-919e-ff2826fc8d78 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:35.517742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b6d8f0d-824d-44c8-919e-ff2826fc8d78 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:35.518498 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b6d8f0d-824d-44c8-919e-ff2826fc8d78 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:35.519946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b6d8f0d-824d-44c8-919e-ff2826fc8d78 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:35.521037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b6d8f0d-824d-44c8-919e-ff2826fc8d78 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:35.684590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4b6d8f0d-824d-44c8-919e-ff2826fc8d78 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:35.693337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4b6d8f0d-824d-44c8-919e-ff2826fc8d78 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.197591 Jul 18 16:51:35.693926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 197/395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:35 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:36.711601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5ed0992c-aa70-48be-8f79-ff884424e50a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:36.712305 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5ed0992c-aa70-48be-8f79-ff884424e50a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:36.719406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5ed0992c-aa70-48be-8f79-ff884424e50a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.719888 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5ed0992c-aa70-48be-8f79-ff884424e50a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.720668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5ed0992c-aa70-48be-8f79-ff884424e50a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:36.721099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5ed0992c-aa70-48be-8f79-ff884424e50a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:36.878901 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5ed0992c-aa70-48be-8f79-ff884424e50a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:36.887605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5ed0992c-aa70-48be-8f79-ff884424e50a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.179951 Jul 18 16:51:36.888188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 199/396] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:36 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:37.906395 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0b38cb4c-3f30-41c1-bf85-bab56d5e6a9c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:37.907068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0b38cb4c-3f30-41c1-bf85-bab56d5e6a9c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:37.909569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=27 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:37.915835 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b38cb4c-3f30-41c1-bf85-bab56d5e6a9c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:37.916285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b38cb4c-3f30-41c1-bf85-bab56d5e6a9c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:37.917140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b38cb4c-3f30-41c1-bf85-bab56d5e6a9c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:37.917628 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b38cb4c-3f30-41c1-bf85-bab56d5e6a9c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:37.920973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=79 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:38.074809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0b38cb4c-3f30-41c1-bf85-bab56d5e6a9c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:38.084968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0b38cb4c-3f30-41c1-bf85-bab56d5e6a9c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.182569 Jul 18 16:51:38.085565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 198/397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:37 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:39.102967 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4a4d3d90-8eca-4b86-a352-29ad8c4fb92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:39.103882 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4a4d3d90-8eca-4b86-a352-29ad8c4fb92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:39.106409 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=29 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:39.113445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a4d3d90-8eca-4b86-a352-29ad8c4fb92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.118003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a4d3d90-8eca-4b86-a352-29ad8c4fb92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.118003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a4d3d90-8eca-4b86-a352-29ad8c4fb92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:39.118003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a4d3d90-8eca-4b86-a352-29ad8c4fb92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:39.118475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:39.290007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4a4d3d90-8eca-4b86-a352-29ad8c4fb92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:39.299612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4a4d3d90-8eca-4b86-a352-29ad8c4fb92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.200644 Jul 18 16:51:39.300258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 200/398] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:39 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:40.317932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-db1d9021-21c9-4305-a4ca-0f239eee19d2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:40.318639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-db1d9021-21c9-4305-a4ca-0f239eee19d2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:40.326523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db1d9021-21c9-4305-a4ca-0f239eee19d2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.327024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db1d9021-21c9-4305-a4ca-0f239eee19d2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:40.327941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db1d9021-21c9-4305-a4ca-0f239eee19d2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:40.328448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db1d9021-21c9-4305-a4ca-0f239eee19d2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:40.520210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-db1d9021-21c9-4305-a4ca-0f239eee19d2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:40.529268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-db1d9021-21c9-4305-a4ca-0f239eee19d2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.215281 Jul 18 16:51:40.529861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 199/399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:40 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:41.556516 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d7211dcc-a411-40d2-9a1b-ad253e458b19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:41.557231 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d7211dcc-a411-40d2-9a1b-ad253e458b19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:41.565386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d7211dcc-a411-40d2-9a1b-ad253e458b19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:41.565827 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d7211dcc-a411-40d2-9a1b-ad253e458b19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.566612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d7211dcc-a411-40d2-9a1b-ad253e458b19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:41.567113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d7211dcc-a411-40d2-9a1b-ad253e458b19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:41.730680 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d7211dcc-a411-40d2-9a1b-ad253e458b19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:41.739797 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d7211dcc-a411-40d2-9a1b-ad253e458b19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.187281 Jul 18 16:51:41.740382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 201/400] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:41 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:42.758331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6a672991-c53b-47d0-a778-8e4eb58aeeb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:42.759009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6a672991-c53b-47d0-a778-8e4eb58aeeb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:42.766289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a672991-c53b-47d0-a778-8e4eb58aeeb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.766744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a672991-c53b-47d0-a778-8e4eb58aeeb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.767546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a672991-c53b-47d0-a778-8e4eb58aeeb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:42.767988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a672991-c53b-47d0-a778-8e4eb58aeeb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:42.941375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6a672991-c53b-47d0-a778-8e4eb58aeeb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:42.950087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6a672991-c53b-47d0-a778-8e4eb58aeeb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.196076 Jul 18 16:51:42.950715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 200/401] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:42 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:43.968894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b13d6d78-0d64-4e21-99fa-0e2e93f6995c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:43.969715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b13d6d78-0d64-4e21-99fa-0e2e93f6995c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:43.976269 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b13d6d78-0d64-4e21-99fa-0e2e93f6995c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.976715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b13d6d78-0d64-4e21-99fa-0e2e93f6995c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:43.977669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b13d6d78-0d64-4e21-99fa-0e2e93f6995c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:43.978105 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b13d6d78-0d64-4e21-99fa-0e2e93f6995c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:44.132489 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b13d6d78-0d64-4e21-99fa-0e2e93f6995c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:44.141984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b13d6d78-0d64-4e21-99fa-0e2e93f6995c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.177651 Jul 18 16:51:44.142563 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 202/402] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:43 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:45.160600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-220a3031-7d06-4c66-9a5b-e568ec786136 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:45.161278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-220a3031-7d06-4c66-9a5b-e568ec786136 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:45.168622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-220a3031-7d06-4c66-9a5b-e568ec786136 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:45.169073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-220a3031-7d06-4c66-9a5b-e568ec786136 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:45.169860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-220a3031-7d06-4c66-9a5b-e568ec786136 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:45.170293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-220a3031-7d06-4c66-9a5b-e568ec786136 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:45.339134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-220a3031-7d06-4c66-9a5b-e568ec786136 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:45.348366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-220a3031-7d06-4c66-9a5b-e568ec786136 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.191905 Jul 18 16:51:45.348969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 201/403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:45 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:46.366821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-27a53047-8ac5-49f1-9aa7-279aeebfdad9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:46.367547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-27a53047-8ac5-49f1-9aa7-279aeebfdad9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:46.375361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-27a53047-8ac5-49f1-9aa7-279aeebfdad9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.375961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-27a53047-8ac5-49f1-9aa7-279aeebfdad9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.376896 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-27a53047-8ac5-49f1-9aa7-279aeebfdad9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:46.377382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-27a53047-8ac5-49f1-9aa7-279aeebfdad9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:46.526884 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-27a53047-8ac5-49f1-9aa7-279aeebfdad9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:46.535598 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-27a53047-8ac5-49f1-9aa7-279aeebfdad9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.172759 Jul 18 16:51:46.536207 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 203/404] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:46 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:47.553878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5c36f61b-fbce-45d7-9a3d-ef9075badb19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:47.615241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5c36f61b-fbce-45d7-9a3d-ef9075badb19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:47.615241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5c36f61b-fbce-45d7-9a3d-ef9075badb19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.615241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5c36f61b-fbce-45d7-9a3d-ef9075badb19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.615241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5c36f61b-fbce-45d7-9a3d-ef9075badb19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:47.615722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5c36f61b-fbce-45d7-9a3d-ef9075badb19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:47.718832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5c36f61b-fbce-45d7-9a3d-ef9075badb19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:47.726702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5c36f61b-fbce-45d7-9a3d-ef9075badb19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.176956 Jul 18 16:51:47.727265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 202/405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:47 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:48.744828 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c4482f24-9c13-4494-aa3e-62c82eb5a3f9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:48.745445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c4482f24-9c13-4494-aa3e-62c82eb5a3f9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:48.752404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c4482f24-9c13-4494-aa3e-62c82eb5a3f9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.752856 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c4482f24-9c13-4494-aa3e-62c82eb5a3f9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.753630 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c4482f24-9c13-4494-aa3e-62c82eb5a3f9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:48.754068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c4482f24-9c13-4494-aa3e-62c82eb5a3f9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:48.921620 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c4482f24-9c13-4494-aa3e-62c82eb5a3f9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:48.929951 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c4482f24-9c13-4494-aa3e-62c82eb5a3f9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.189050 Jul 18 16:51:48.930559 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 204/406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:48 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:49.948503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-15cfc2b8-378c-482f-af65-fe31a0d7b901 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:49.949142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-15cfc2b8-378c-482f-af65-fe31a0d7b901 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:49.956975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15cfc2b8-378c-482f-af65-fe31a0d7b901 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.957423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15cfc2b8-378c-482f-af65-fe31a0d7b901 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:49.958192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15cfc2b8-378c-482f-af65-fe31a0d7b901 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:49.958621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15cfc2b8-378c-482f-af65-fe31a0d7b901 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:50.103918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-15cfc2b8-378c-482f-af65-fe31a0d7b901 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:50.117149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-15cfc2b8-378c-482f-af65-fe31a0d7b901 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.172354 Jul 18 16:51:50.118246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 203/407] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:49 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:51.146169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6358ad55-4c2d-4665-82d2-558a96d18564 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:51.147183 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6358ad55-4c2d-4665-82d2-558a96d18564 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:51.155324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6358ad55-4c2d-4665-82d2-558a96d18564 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.155837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6358ad55-4c2d-4665-82d2-558a96d18564 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.156664 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6358ad55-4c2d-4665-82d2-558a96d18564 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:51.157064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6358ad55-4c2d-4665-82d2-558a96d18564 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:51.355027 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6358ad55-4c2d-4665-82d2-558a96d18564 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:51.363727 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6358ad55-4c2d-4665-82d2-558a96d18564 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.222752 Jul 18 16:51:51.364402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 205/408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:51 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:52.380854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ed4798b8-939b-4346-b818-5b2e16ae6ae3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:52.381391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ed4798b8-939b-4346-b818-5b2e16ae6ae3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:52.389322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed4798b8-939b-4346-b818-5b2e16ae6ae3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.389713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed4798b8-939b-4346-b818-5b2e16ae6ae3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.390519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed4798b8-939b-4346-b818-5b2e16ae6ae3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:52.390954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed4798b8-939b-4346-b818-5b2e16ae6ae3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:52.545695 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ed4798b8-939b-4346-b818-5b2e16ae6ae3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:52.553352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ed4798b8-939b-4346-b818-5b2e16ae6ae3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.176422 Jul 18 16:51:52.553921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 204/409] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:52 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:53.576048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a92e3dcc-1053-47b6-b7fa-de3b6302c75e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:53.576048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a92e3dcc-1053-47b6-b7fa-de3b6302c75e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:53.579132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a92e3dcc-1053-47b6-b7fa-de3b6302c75e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.579710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a92e3dcc-1053-47b6-b7fa-de3b6302c75e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.580528 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a92e3dcc-1053-47b6-b7fa-de3b6302c75e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:53.580968 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a92e3dcc-1053-47b6-b7fa-de3b6302c75e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:53.733372 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a92e3dcc-1053-47b6-b7fa-de3b6302c75e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:53.741089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a92e3dcc-1053-47b6-b7fa-de3b6302c75e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174067 Jul 18 16:51:53.741995 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 206/410] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:53 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:54.758381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b6f49bb5-cefd-4875-a077-71b86f5d3572 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:54.759023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b6f49bb5-cefd-4875-a077-71b86f5d3572 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:54.766552 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6f49bb5-cefd-4875-a077-71b86f5d3572 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.767001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6f49bb5-cefd-4875-a077-71b86f5d3572 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.767824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6f49bb5-cefd-4875-a077-71b86f5d3572 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:54.768265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6f49bb5-cefd-4875-a077-71b86f5d3572 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:54.930773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b6f49bb5-cefd-4875-a077-71b86f5d3572 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:54.939582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b6f49bb5-cefd-4875-a077-71b86f5d3572 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.185037 Jul 18 16:51:54.940171 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 205/411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:54 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:55.957838 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bbca4748-5b42-43b1-be7e-17d0ab63d747 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:55.958694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bbca4748-5b42-43b1-be7e-17d0ab63d747 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:55.965241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bbca4748-5b42-43b1-be7e-17d0ab63d747 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.965868 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bbca4748-5b42-43b1-be7e-17d0ab63d747 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:55.966787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bbca4748-5b42-43b1-be7e-17d0ab63d747 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:55.967135 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bbca4748-5b42-43b1-be7e-17d0ab63d747 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:56.119046 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bbca4748-5b42-43b1-be7e-17d0ab63d747 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:56.128491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bbca4748-5b42-43b1-be7e-17d0ab63d747 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174578 Jul 18 16:51:56.129105 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 207/412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:55 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:57.145822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-37de8e22-d1d4-45db-bfc8-b5a101f4fcc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:57.146416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37de8e22-d1d4-45db-bfc8-b5a101f4fcc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:57.153953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37de8e22-d1d4-45db-bfc8-b5a101f4fcc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.154393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37de8e22-d1d4-45db-bfc8-b5a101f4fcc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.155179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37de8e22-d1d4-45db-bfc8-b5a101f4fcc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:57.155648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37de8e22-d1d4-45db-bfc8-b5a101f4fcc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:57.301675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37de8e22-d1d4-45db-bfc8-b5a101f4fcc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:57.311919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-37de8e22-d1d4-45db-bfc8-b5a101f4fcc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.169990 Jul 18 16:51:57.314706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 206/413] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:57 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:51:58.329392 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7e5de647-bac0-48f3-b4db-1a4a982a3647 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:58.330024 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7e5de647-bac0-48f3-b4db-1a4a982a3647 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:58.336241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e5de647-bac0-48f3-b4db-1a4a982a3647 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.336706 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e5de647-bac0-48f3-b4db-1a4a982a3647 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.337481 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e5de647-bac0-48f3-b4db-1a4a982a3647 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:58.337937 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e5de647-bac0-48f3-b4db-1a4a982a3647 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:58.476785 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7e5de647-bac0-48f3-b4db-1a4a982a3647 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:58.486109 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7e5de647-bac0-48f3-b4db-1a4a982a3647 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160462 Jul 18 16:51:58.486719 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 208/414] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:58 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:51:59.503279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1350ccbc-682b-463f-9ff1-fc6b66fcae54 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:51:59.503909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1350ccbc-682b-463f-9ff1-fc6b66fcae54 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:51:59.510451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1350ccbc-682b-463f-9ff1-fc6b66fcae54 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.510905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1350ccbc-682b-463f-9ff1-fc6b66fcae54 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.512285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1350ccbc-682b-463f-9ff1-fc6b66fcae54 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:51:59.512727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1350ccbc-682b-463f-9ff1-fc6b66fcae54 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:51:59.672612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1350ccbc-682b-463f-9ff1-fc6b66fcae54 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:51:59.680408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1350ccbc-682b-463f-9ff1-fc6b66fcae54 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.180916 Jul 18 16:51:59.680985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 207/415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:51:59 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:00.699059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b3167e57-5618-4866-b433-b7571ff1fd82 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:00.699886 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b3167e57-5618-4866-b433-b7571ff1fd82 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:00.706603 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b3167e57-5618-4866-b433-b7571ff1fd82 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.707059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b3167e57-5618-4866-b433-b7571ff1fd82 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.707926 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b3167e57-5618-4866-b433-b7571ff1fd82 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:00.708377 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b3167e57-5618-4866-b433-b7571ff1fd82 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:00.870372 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b3167e57-5618-4866-b433-b7571ff1fd82 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:00.878510 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b3167e57-5618-4866-b433-b7571ff1fd82 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.183447 Jul 18 16:52:00.879105 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 209/416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:00 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:01.897227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-330f6759-d26d-44f4-b9b1-722c07a76003 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:01.897887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-330f6759-d26d-44f4-b9b1-722c07a76003 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:01.905008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-330f6759-d26d-44f4-b9b1-722c07a76003 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.905453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-330f6759-d26d-44f4-b9b1-722c07a76003 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:01.906236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-330f6759-d26d-44f4-b9b1-722c07a76003 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:01.906669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-330f6759-d26d-44f4-b9b1-722c07a76003 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:02.058829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-330f6759-d26d-44f4-b9b1-722c07a76003 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:02.066937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-330f6759-d26d-44f4-b9b1-722c07a76003 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.173746 Jul 18 16:52:02.067555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 208/417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:01 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:03.085783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-be9ae901-8f22-4bd7-87ea-cea0ec89ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:03.086374 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-be9ae901-8f22-4bd7-87ea-cea0ec89ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:03.093433 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be9ae901-8f22-4bd7-87ea-cea0ec89ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.093795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be9ae901-8f22-4bd7-87ea-cea0ec89ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.094571 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be9ae901-8f22-4bd7-87ea-cea0ec89ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:03.095005 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be9ae901-8f22-4bd7-87ea-cea0ec89ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:03.253735 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-be9ae901-8f22-4bd7-87ea-cea0ec89ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:03.261940 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-be9ae901-8f22-4bd7-87ea-cea0ec89ce18 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.179964 Jul 18 16:52:03.262527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 210/418] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:03 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:04.288745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-06c6eaf6-7df4-44a2-a07b-24c054d6f92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:04.289374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-06c6eaf6-7df4-44a2-a07b-24c054d6f92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:04.296691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-06c6eaf6-7df4-44a2-a07b-24c054d6f92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.297143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-06c6eaf6-7df4-44a2-a07b-24c054d6f92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.297912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-06c6eaf6-7df4-44a2-a07b-24c054d6f92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:04.298348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-06c6eaf6-7df4-44a2-a07b-24c054d6f92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:04.438812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-06c6eaf6-7df4-44a2-a07b-24c054d6f92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:04.446719 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-06c6eaf6-7df4-44a2-a07b-24c054d6f92c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162053 Jul 18 16:52:04.447305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 209/419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:04 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:05.464875 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5d2df17b-6a25-469a-bce9-a2e3db507977 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:05.465485 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5d2df17b-6a25-469a-bce9-a2e3db507977 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:05.473707 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d2df17b-6a25-469a-bce9-a2e3db507977 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.474150 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d2df17b-6a25-469a-bce9-a2e3db507977 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.474929 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d2df17b-6a25-469a-bce9-a2e3db507977 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:05.475588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d2df17b-6a25-469a-bce9-a2e3db507977 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:05.626917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5d2df17b-6a25-469a-bce9-a2e3db507977 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:05.634955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5d2df17b-6a25-469a-bce9-a2e3db507977 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174551 Jul 18 16:52:05.635656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 211/420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:05 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:06.801262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f4e84f1f-b316-4d47-84ce-4d8fbda9c229 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:06.802013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f4e84f1f-b316-4d47-84ce-4d8fbda9c229 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:06.809489 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4e84f1f-b316-4d47-84ce-4d8fbda9c229 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.809996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4e84f1f-b316-4d47-84ce-4d8fbda9c229 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.810885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4e84f1f-b316-4d47-84ce-4d8fbda9c229 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:06.811334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4e84f1f-b316-4d47-84ce-4d8fbda9c229 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:06.963367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f4e84f1f-b316-4d47-84ce-4d8fbda9c229 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:06.972439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f4e84f1f-b316-4d47-84ce-4d8fbda9c229 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.323878 Jul 18 16:52:06.973058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 210/421] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:06 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:07.989284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5c1e97ad-279e-4786-b49f-d2fc4ec1b643 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:07.989913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5c1e97ad-279e-4786-b49f-d2fc4ec1b643 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:07.996614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c1e97ad-279e-4786-b49f-d2fc4ec1b643 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:07.997055 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c1e97ad-279e-4786-b49f-d2fc4ec1b643 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:07.997827 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c1e97ad-279e-4786-b49f-d2fc4ec1b643 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:07.998286 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c1e97ad-279e-4786-b49f-d2fc4ec1b643 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:08.143352 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5c1e97ad-279e-4786-b49f-d2fc4ec1b643 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:08.152272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5c1e97ad-279e-4786-b49f-d2fc4ec1b643 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.166753 Jul 18 16:52:08.152844 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 212/422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:09.170806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6e01f30e-20fd-4ee9-b8c3-41e13c43c2d0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:09.171451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6e01f30e-20fd-4ee9-b8c3-41e13c43c2d0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:09.173790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:09.178604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6e01f30e-20fd-4ee9-b8c3-41e13c43c2d0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.179043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6e01f30e-20fd-4ee9-b8c3-41e13c43c2d0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.179836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6e01f30e-20fd-4ee9-b8c3-41e13c43c2d0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:09.180272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6e01f30e-20fd-4ee9-b8c3-41e13c43c2d0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:09.183792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:09.357844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6e01f30e-20fd-4ee9-b8c3-41e13c43c2d0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:09.366004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6e01f30e-20fd-4ee9-b8c3-41e13c43c2d0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.200089 Jul 18 16:52:09.366573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 211/423] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:09 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:10.386923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-669efcfa-b17d-4c76-9355-ea544664b4ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:10.386923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-669efcfa-b17d-4c76-9355-ea544664b4ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:10.386923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=26 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:10.391691 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-669efcfa-b17d-4c76-9355-ea544664b4ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.398494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-669efcfa-b17d-4c76-9355-ea544664b4ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.398494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-669efcfa-b17d-4c76-9355-ea544664b4ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:10.398494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-669efcfa-b17d-4c76-9355-ea544664b4ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:10.398494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=78 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:10.545013 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-669efcfa-b17d-4c76-9355-ea544664b4ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:10.552757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-669efcfa-b17d-4c76-9355-ea544664b4ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.172864 Jul 18 16:52:10.553322 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 213/424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:10 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:11.570538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-131b8d79-1eec-40f4-94ee-6badeb144a5b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:11.571214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-131b8d79-1eec-40f4-94ee-6badeb144a5b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:11.578938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-131b8d79-1eec-40f4-94ee-6badeb144a5b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.579562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-131b8d79-1eec-40f4-94ee-6badeb144a5b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.580396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-131b8d79-1eec-40f4-94ee-6badeb144a5b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:11.580981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-131b8d79-1eec-40f4-94ee-6badeb144a5b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:11.722102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-131b8d79-1eec-40f4-94ee-6badeb144a5b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:11.729877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-131b8d79-1eec-40f4-94ee-6badeb144a5b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163481 Jul 18 16:52:11.730456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 212/425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:11 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:12.748165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8a7e57ea-ba5a-4dd4-90c2-5ada73797e05 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:12.748770 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8a7e57ea-ba5a-4dd4-90c2-5ada73797e05 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:12.755774 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8a7e57ea-ba5a-4dd4-90c2-5ada73797e05 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.756222 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8a7e57ea-ba5a-4dd4-90c2-5ada73797e05 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.756993 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8a7e57ea-ba5a-4dd4-90c2-5ada73797e05 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:12.757461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8a7e57ea-ba5a-4dd4-90c2-5ada73797e05 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:12.905018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8a7e57ea-ba5a-4dd4-90c2-5ada73797e05 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:12.917263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8a7e57ea-ba5a-4dd4-90c2-5ada73797e05 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171835 Jul 18 16:52:12.918062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 214/426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:12 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:13.938699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a6e43921-68d5-421d-863b-18fa8b5c134b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:13.939385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a6e43921-68d5-421d-863b-18fa8b5c134b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:13.947826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a6e43921-68d5-421d-863b-18fa8b5c134b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.948377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a6e43921-68d5-421d-863b-18fa8b5c134b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:13.949174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a6e43921-68d5-421d-863b-18fa8b5c134b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:13.949613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a6e43921-68d5-421d-863b-18fa8b5c134b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:14.105150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a6e43921-68d5-421d-863b-18fa8b5c134b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:14.113722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a6e43921-68d5-421d-863b-18fa8b5c134b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.178824 Jul 18 16:52:14.114308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 213/427] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:13 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:15.131176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e39e99c1-bfaa-433a-9ed4-d1b4bde4981e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:15.131768 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e39e99c1-bfaa-433a-9ed4-d1b4bde4981e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:15.139116 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e39e99c1-bfaa-433a-9ed4-d1b4bde4981e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.139592 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e39e99c1-bfaa-433a-9ed4-d1b4bde4981e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.140365 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e39e99c1-bfaa-433a-9ed4-d1b4bde4981e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:15.140793 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e39e99c1-bfaa-433a-9ed4-d1b4bde4981e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:15.297557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e39e99c1-bfaa-433a-9ed4-d1b4bde4981e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:15.306114 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e39e99c1-bfaa-433a-9ed4-d1b4bde4981e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.178124 Jul 18 16:52:15.306786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 215/428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:15 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:16.326264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-59acfeaa-49ae-4dff-bc3a-308dc738ed4e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:16.327348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-59acfeaa-49ae-4dff-bc3a-308dc738ed4e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:16.337925 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59acfeaa-49ae-4dff-bc3a-308dc738ed4e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:16.338728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59acfeaa-49ae-4dff-bc3a-308dc738ed4e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:16.340156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59acfeaa-49ae-4dff-bc3a-308dc738ed4e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:16.340935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59acfeaa-49ae-4dff-bc3a-308dc738ed4e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:16.495221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59acfeaa-49ae-4dff-bc3a-308dc738ed4e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:16.504716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-59acfeaa-49ae-4dff-bc3a-308dc738ed4e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.185502 Jul 18 16:52:16.505295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 214/429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:16 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:17.528497 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-eac94b83-4b26-4355-b02b-24fe200e30d8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:17.529124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-eac94b83-4b26-4355-b02b-24fe200e30d8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:17.535946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eac94b83-4b26-4355-b02b-24fe200e30d8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.536397 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eac94b83-4b26-4355-b02b-24fe200e30d8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.537175 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eac94b83-4b26-4355-b02b-24fe200e30d8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:17.537614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eac94b83-4b26-4355-b02b-24fe200e30d8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:17.717580 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-eac94b83-4b26-4355-b02b-24fe200e30d8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:17.726177 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-eac94b83-4b26-4355-b02b-24fe200e30d8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.201824 Jul 18 16:52:17.726758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 216/430] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:17 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:18.747609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c08ae299-53e4-44e5-ac75-f2bd2ad3abbe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:18.748318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c08ae299-53e4-44e5-ac75-f2bd2ad3abbe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:18.761760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c08ae299-53e4-44e5-ac75-f2bd2ad3abbe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:18.762213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c08ae299-53e4-44e5-ac75-f2bd2ad3abbe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:18.763016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c08ae299-53e4-44e5-ac75-f2bd2ad3abbe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:18.763455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c08ae299-53e4-44e5-ac75-f2bd2ad3abbe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:18.938918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c08ae299-53e4-44e5-ac75-f2bd2ad3abbe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:18.948610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c08ae299-53e4-44e5-ac75-f2bd2ad3abbe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.207808 Jul 18 16:52:18.949304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 215/431] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:18 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:19.967748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-df518d6b-24ad-409f-b9d1-9330bc2a4cef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:19.969762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-df518d6b-24ad-409f-b9d1-9330bc2a4cef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:19.977511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df518d6b-24ad-409f-b9d1-9330bc2a4cef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:19.978108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df518d6b-24ad-409f-b9d1-9330bc2a4cef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:19.979121 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df518d6b-24ad-409f-b9d1-9330bc2a4cef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:19.979710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df518d6b-24ad-409f-b9d1-9330bc2a4cef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:20.142143 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-df518d6b-24ad-409f-b9d1-9330bc2a4cef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:20.150570 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-df518d6b-24ad-409f-b9d1-9330bc2a4cef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.186877 Jul 18 16:52:20.151224 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 217/432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:19 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:21.169448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-14f23aa2-44c8-40bb-bd76-645cd7de1b3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:21.170040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-14f23aa2-44c8-40bb-bd76-645cd7de1b3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:21.177697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14f23aa2-44c8-40bb-bd76-645cd7de1b3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:21.178136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14f23aa2-44c8-40bb-bd76-645cd7de1b3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:21.178901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14f23aa2-44c8-40bb-bd76-645cd7de1b3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:21.179337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14f23aa2-44c8-40bb-bd76-645cd7de1b3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:21.367904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-14f23aa2-44c8-40bb-bd76-645cd7de1b3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:21.380682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-14f23aa2-44c8-40bb-bd76-645cd7de1b3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.214906 Jul 18 16:52:21.381708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 216/433] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:22.399537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-83cdb955-b1ef-4c6f-b0fa-e8fca04c3b98 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:22.400582 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-83cdb955-b1ef-4c6f-b0fa-e8fca04c3b98 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:22.407328 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-83cdb955-b1ef-4c6f-b0fa-e8fca04c3b98 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:22.407807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-83cdb955-b1ef-4c6f-b0fa-e8fca04c3b98 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:22.408586 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-83cdb955-b1ef-4c6f-b0fa-e8fca04c3b98 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:22.409027 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-83cdb955-b1ef-4c6f-b0fa-e8fca04c3b98 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:22.557490 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-83cdb955-b1ef-4c6f-b0fa-e8fca04c3b98 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:22.565202 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-83cdb955-b1ef-4c6f-b0fa-e8fca04c3b98 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.170206 Jul 18 16:52:22.566032 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 218/434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:23.584607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fd3cdd81-4cde-44ce-b5fe-401f6781ab0c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:23.585320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fd3cdd81-4cde-44ce-b5fe-401f6781ab0c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:23.593153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd3cdd81-4cde-44ce-b5fe-401f6781ab0c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:23.593656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd3cdd81-4cde-44ce-b5fe-401f6781ab0c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:23.594487 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd3cdd81-4cde-44ce-b5fe-401f6781ab0c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:23.594958 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd3cdd81-4cde-44ce-b5fe-401f6781ab0c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:23.736980 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fd3cdd81-4cde-44ce-b5fe-401f6781ab0c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:23.745846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fd3cdd81-4cde-44ce-b5fe-401f6781ab0c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165320 Jul 18 16:52:23.746517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 217/435] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:24.763448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6c40e03e-68f4-42f9-a6da-e9573e2419e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:24.764103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6c40e03e-68f4-42f9-a6da-e9573e2419e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:24.770535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6c40e03e-68f4-42f9-a6da-e9573e2419e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:24.770978 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6c40e03e-68f4-42f9-a6da-e9573e2419e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:24.771760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6c40e03e-68f4-42f9-a6da-e9573e2419e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:24.772185 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6c40e03e-68f4-42f9-a6da-e9573e2419e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:24.918178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6c40e03e-68f4-42f9-a6da-e9573e2419e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:24.925710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6c40e03e-68f4-42f9-a6da-e9573e2419e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.166141 Jul 18 16:52:24.926277 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 219/436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:24 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:25.943407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7de4b771-4b31-4ef6-8190-c45b691c8924 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:25.944110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7de4b771-4b31-4ef6-8190-c45b691c8924 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:25.952714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7de4b771-4b31-4ef6-8190-c45b691c8924 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:25.953212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7de4b771-4b31-4ef6-8190-c45b691c8924 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:25.954141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7de4b771-4b31-4ef6-8190-c45b691c8924 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:25.954573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7de4b771-4b31-4ef6-8190-c45b691c8924 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:26.118794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7de4b771-4b31-4ef6-8190-c45b691c8924 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:26.127140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7de4b771-4b31-4ef6-8190-c45b691c8924 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.188000 Jul 18 16:52:26.127760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 218/437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:27.145999 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-be4a9b39-e4eb-47b8-be9b-95de83628f49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:27.146607 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-be4a9b39-e4eb-47b8-be9b-95de83628f49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:27.153512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be4a9b39-e4eb-47b8-be9b-95de83628f49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:27.153958 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be4a9b39-e4eb-47b8-be9b-95de83628f49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:27.154735 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be4a9b39-e4eb-47b8-be9b-95de83628f49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:27.155318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be4a9b39-e4eb-47b8-be9b-95de83628f49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:27.301672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-be4a9b39-e4eb-47b8-be9b-95de83628f49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:27.309526 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-be4a9b39-e4eb-47b8-be9b-95de83628f49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.167356 Jul 18 16:52:27.310085 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 220/438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:28.326889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1c734693-71f7-4bc2-92a4-201d9ca2f84e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:28.327518 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1c734693-71f7-4bc2-92a4-201d9ca2f84e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:28.335346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c734693-71f7-4bc2-92a4-201d9ca2f84e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:28.335827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c734693-71f7-4bc2-92a4-201d9ca2f84e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:28.336612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c734693-71f7-4bc2-92a4-201d9ca2f84e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:28.337041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c734693-71f7-4bc2-92a4-201d9ca2f84e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:28.479564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1c734693-71f7-4bc2-92a4-201d9ca2f84e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:28.488456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1c734693-71f7-4bc2-92a4-201d9ca2f84e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165327 Jul 18 16:52:28.489017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 219/439] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:28 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:29.507606 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-25e0014f-5990-4637-afb6-bcabecc59bfa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:29.508502 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-25e0014f-5990-4637-afb6-bcabecc59bfa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:29.514824 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-25e0014f-5990-4637-afb6-bcabecc59bfa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.515265 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-25e0014f-5990-4637-afb6-bcabecc59bfa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.516102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-25e0014f-5990-4637-afb6-bcabecc59bfa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:29.516535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-25e0014f-5990-4637-afb6-bcabecc59bfa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:29.680296 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-25e0014f-5990-4637-afb6-bcabecc59bfa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:29.688372 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-25e0014f-5990-4637-afb6-bcabecc59bfa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.185794 Jul 18 16:52:29.689545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 221/440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:29 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:30.708022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1587608a-6d3b-41f5-8828-c56349c52ec2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:30.708871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1587608a-6d3b-41f5-8828-c56349c52ec2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:30.717136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1587608a-6d3b-41f5-8828-c56349c52ec2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:30.717901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1587608a-6d3b-41f5-8828-c56349c52ec2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:30.718865 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1587608a-6d3b-41f5-8828-c56349c52ec2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:30.719627 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1587608a-6d3b-41f5-8828-c56349c52ec2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:30.873017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1587608a-6d3b-41f5-8828-c56349c52ec2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:30.881237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1587608a-6d3b-41f5-8828-c56349c52ec2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.177047 Jul 18 16:52:30.882554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 220/441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:30 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:31.900459 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2a84d3cd-3fd4-4eb8-b200-a5bb15a91c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:31.910137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2a84d3cd-3fd4-4eb8-b200-a5bb15a91c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:31.910137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2a84d3cd-3fd4-4eb8-b200-a5bb15a91c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:31.910137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2a84d3cd-3fd4-4eb8-b200-a5bb15a91c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:31.910137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2a84d3cd-3fd4-4eb8-b200-a5bb15a91c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:31.910535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2a84d3cd-3fd4-4eb8-b200-a5bb15a91c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:32.049660 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2a84d3cd-3fd4-4eb8-b200-a5bb15a91c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:32.058328 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2a84d3cd-3fd4-4eb8-b200-a5bb15a91c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162166 Jul 18 16:52:32.058916 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 222/442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:31 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:33.076241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c2109df9-2d04-45af-942e-2b17312b191b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:33.076846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c2109df9-2d04-45af-942e-2b17312b191b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:33.083198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c2109df9-2d04-45af-942e-2b17312b191b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:33.083746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c2109df9-2d04-45af-942e-2b17312b191b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:33.084726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c2109df9-2d04-45af-942e-2b17312b191b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:33.085163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c2109df9-2d04-45af-942e-2b17312b191b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:33.242225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c2109df9-2d04-45af-942e-2b17312b191b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:33.256067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c2109df9-2d04-45af-942e-2b17312b191b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.183445 Jul 18 16:52:33.257616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 221/443] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:34.274750 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bd50dbe5-e00e-434b-a6d6-954826d8614b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:34.275341 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bd50dbe5-e00e-434b-a6d6-954826d8614b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:34.281572 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd50dbe5-e00e-434b-a6d6-954826d8614b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.282058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd50dbe5-e00e-434b-a6d6-954826d8614b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.282849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd50dbe5-e00e-434b-a6d6-954826d8614b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:34.283300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd50dbe5-e00e-434b-a6d6-954826d8614b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:34.428429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bd50dbe5-e00e-434b-a6d6-954826d8614b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:34.437399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bd50dbe5-e00e-434b-a6d6-954826d8614b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.166579 Jul 18 16:52:34.438068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 223/444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:34 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:35.455300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3c6d15ec-d2ef-43e3-97dc-f51d74687f5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:35.456094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3c6d15ec-d2ef-43e3-97dc-f51d74687f5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:35.463379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c6d15ec-d2ef-43e3-97dc-f51d74687f5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:35.463849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c6d15ec-d2ef-43e3-97dc-f51d74687f5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:35.464615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c6d15ec-d2ef-43e3-97dc-f51d74687f5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:35.465048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c6d15ec-d2ef-43e3-97dc-f51d74687f5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:35.606197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3c6d15ec-d2ef-43e3-97dc-f51d74687f5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:35.613894 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3c6d15ec-d2ef-43e3-97dc-f51d74687f5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162320 Jul 18 16:52:35.614457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 222/445] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:35 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:36.631680 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a85c0d74-4329-4399-b166-68acb61cb994 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:36.632286 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a85c0d74-4329-4399-b166-68acb61cb994 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:36.638541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a85c0d74-4329-4399-b166-68acb61cb994 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.638980 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a85c0d74-4329-4399-b166-68acb61cb994 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.639761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a85c0d74-4329-4399-b166-68acb61cb994 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:36.640190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a85c0d74-4329-4399-b166-68acb61cb994 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:36.777353 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a85c0d74-4329-4399-b166-68acb61cb994 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:36.785125 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a85c0d74-4329-4399-b166-68acb61cb994 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.157815 Jul 18 16:52:36.785714 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 224/446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:36 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:37.803546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a7f26ef3-1853-4da9-948d-cdaf49fc214c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:37.804258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a7f26ef3-1853-4da9-948d-cdaf49fc214c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:37.810869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7f26ef3-1853-4da9-948d-cdaf49fc214c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.811319 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7f26ef3-1853-4da9-948d-cdaf49fc214c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.812120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7f26ef3-1853-4da9-948d-cdaf49fc214c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:37.812556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7f26ef3-1853-4da9-948d-cdaf49fc214c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:37.962953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a7f26ef3-1853-4da9-948d-cdaf49fc214c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:37.971247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a7f26ef3-1853-4da9-948d-cdaf49fc214c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.172527 Jul 18 16:52:37.971871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 223/447] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:37 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:38.994362 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-42912f27-1e44-4567-8c71-69cafaec2375 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:38.994984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-42912f27-1e44-4567-8c71-69cafaec2375 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:39.001417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42912f27-1e44-4567-8c71-69cafaec2375 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.001983 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42912f27-1e44-4567-8c71-69cafaec2375 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.002769 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42912f27-1e44-4567-8c71-69cafaec2375 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:39.003204 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42912f27-1e44-4567-8c71-69cafaec2375 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:39.142649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-42912f27-1e44-4567-8c71-69cafaec2375 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:39.151422 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-42912f27-1e44-4567-8c71-69cafaec2375 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160850 Jul 18 16:52:39.152050 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 225/448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:38 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:40.168903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6240e06f-df04-4d89-ad99-50756a51dfdb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:40.169449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6240e06f-df04-4d89-ad99-50756a51dfdb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:40.171862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:40.177450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6240e06f-df04-4d89-ad99-50756a51dfdb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.182729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6240e06f-df04-4d89-ad99-50756a51dfdb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.182729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6240e06f-df04-4d89-ad99-50756a51dfdb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:40.182729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6240e06f-df04-4d89-ad99-50756a51dfdb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:40.182729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:40.336213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6240e06f-df04-4d89-ad99-50756a51dfdb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:40.343711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6240e06f-df04-4d89-ad99-50756a51dfdb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.178728 Jul 18 16:52:40.344291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 224/449] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:40 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:41.361760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-81102981-ee95-42ba-8d39-d3a0d4ea4794 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:41.362364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-81102981-ee95-42ba-8d39-d3a0d4ea4794 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:41.368956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-81102981-ee95-42ba-8d39-d3a0d4ea4794 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:41.369406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-81102981-ee95-42ba-8d39-d3a0d4ea4794 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:41.370203 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-81102981-ee95-42ba-8d39-d3a0d4ea4794 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:41.370636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-81102981-ee95-42ba-8d39-d3a0d4ea4794 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:41.503633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-81102981-ee95-42ba-8d39-d3a0d4ea4794 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:41.512348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-81102981-ee95-42ba-8d39-d3a0d4ea4794 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.154526 Jul 18 16:52:41.513009 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 226/450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:41 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:42.532697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-de9460d4-b7cf-49b6-b09b-68e745579217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:42.533342 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-de9460d4-b7cf-49b6-b09b-68e745579217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:42.540673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de9460d4-b7cf-49b6-b09b-68e745579217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.541126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de9460d4-b7cf-49b6-b09b-68e745579217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.541911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de9460d4-b7cf-49b6-b09b-68e745579217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:42.542343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de9460d4-b7cf-49b6-b09b-68e745579217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:42.687389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-de9460d4-b7cf-49b6-b09b-68e745579217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:42.695868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-de9460d4-b7cf-49b6-b09b-68e745579217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.166925 Jul 18 16:52:42.696461 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 225/451] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:42 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:43.713238 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-73e1e140-16a9-4466-afc1-3f52b4738a43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:43.713839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-73e1e140-16a9-4466-afc1-3f52b4738a43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:43.717541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=28 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:43.721889 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73e1e140-16a9-4466-afc1-3f52b4738a43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.722343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73e1e140-16a9-4466-afc1-3f52b4738a43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:43.723736 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73e1e140-16a9-4466-afc1-3f52b4738a43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:43.724166 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73e1e140-16a9-4466-afc1-3f52b4738a43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:43.726894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=84 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:43.878183 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-73e1e140-16a9-4466-afc1-3f52b4738a43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:43.886724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-73e1e140-16a9-4466-afc1-3f52b4738a43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.177193 Jul 18 16:52:43.887312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 227/452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:43 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:44.905006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9fbf2b4b-681c-4c6e-878a-357f9f4fcc4f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:44.905591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9fbf2b4b-681c-4c6e-878a-357f9f4fcc4f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:44.913217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fbf2b4b-681c-4c6e-878a-357f9f4fcc4f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.913670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fbf2b4b-681c-4c6e-878a-357f9f4fcc4f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:44.914463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fbf2b4b-681c-4c6e-878a-357f9f4fcc4f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:44.914900 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fbf2b4b-681c-4c6e-878a-357f9f4fcc4f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:45.066667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9fbf2b4b-681c-4c6e-878a-357f9f4fcc4f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:45.076263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9fbf2b4b-681c-4c6e-878a-357f9f4fcc4f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.175005 Jul 18 16:52:45.076861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 226/453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:44 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:46.094964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b16aff91-5111-4a42-a807-83cfee216942 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:46.095587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b16aff91-5111-4a42-a807-83cfee216942 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:46.102496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b16aff91-5111-4a42-a807-83cfee216942 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:46.102936 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b16aff91-5111-4a42-a807-83cfee216942 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:46.103749 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b16aff91-5111-4a42-a807-83cfee216942 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:46.104168 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b16aff91-5111-4a42-a807-83cfee216942 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:46.261388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b16aff91-5111-4a42-a807-83cfee216942 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:46.270212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b16aff91-5111-4a42-a807-83cfee216942 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.179001 Jul 18 16:52:46.270802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 228/454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:46 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:47.289197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b4598a9d-d077-4192-ba29-a1ddd2d40b84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:47.289844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b4598a9d-d077-4192-ba29-a1ddd2d40b84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:47.296891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4598a9d-d077-4192-ba29-a1ddd2d40b84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:47.297356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4598a9d-d077-4192-ba29-a1ddd2d40b84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:47.298126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4598a9d-d077-4192-ba29-a1ddd2d40b84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:47.298556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4598a9d-d077-4192-ba29-a1ddd2d40b84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:47.458935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b4598a9d-d077-4192-ba29-a1ddd2d40b84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:47.467520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b4598a9d-d077-4192-ba29-a1ddd2d40b84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.183659 Jul 18 16:52:47.468108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 227/455] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:47 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:48.486216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8cae1442-06f5-4a30-af4a-c55dc269ef4d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:48.486824 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8cae1442-06f5-4a30-af4a-c55dc269ef4d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:48.494006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cae1442-06f5-4a30-af4a-c55dc269ef4d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:48.494453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cae1442-06f5-4a30-af4a-c55dc269ef4d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:48.495229 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cae1442-06f5-4a30-af4a-c55dc269ef4d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:48.495698 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cae1442-06f5-4a30-af4a-c55dc269ef4d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:48.645019 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8cae1442-06f5-4a30-af4a-c55dc269ef4d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:48.653116 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8cae1442-06f5-4a30-af4a-c55dc269ef4d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171233 Jul 18 16:52:48.653693 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 229/456] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:48 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:49.676838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e0516e7b-54eb-49ea-91be-f1a96b6e55ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:49.677447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e0516e7b-54eb-49ea-91be-f1a96b6e55ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:49.684693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0516e7b-54eb-49ea-91be-f1a96b6e55ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:49.685141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0516e7b-54eb-49ea-91be-f1a96b6e55ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:49.685916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0516e7b-54eb-49ea-91be-f1a96b6e55ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:49.686350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0516e7b-54eb-49ea-91be-f1a96b6e55ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:49.833650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e0516e7b-54eb-49ea-91be-f1a96b6e55ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:49.844083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e0516e7b-54eb-49ea-91be-f1a96b6e55ca tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171221 Jul 18 16:52:49.844678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 228/457] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:49 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:49.903212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:52:49.903472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 16:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:52:50.862421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-63480afb-540b-487c-a614-478d176b79a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:50.863356 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-63480afb-540b-487c-a614-478d176b79a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:50.869567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63480afb-540b-487c-a614-478d176b79a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:50.870017 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63480afb-540b-487c-a614-478d176b79a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:50.870786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63480afb-540b-487c-a614-478d176b79a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:50.871224 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63480afb-540b-487c-a614-478d176b79a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:51.021439 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-63480afb-540b-487c-a614-478d176b79a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:51.029176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-63480afb-540b-487c-a614-478d176b79a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.170640 Jul 18 16:52:51.029749 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 230/458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:50 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:52.047174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-307556fc-149e-48dc-8d19-b5aded735cb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:52.047758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-307556fc-149e-48dc-8d19-b5aded735cb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:52.055471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-307556fc-149e-48dc-8d19-b5aded735cb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:52.055946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-307556fc-149e-48dc-8d19-b5aded735cb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:52.056743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-307556fc-149e-48dc-8d19-b5aded735cb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:52.057199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-307556fc-149e-48dc-8d19-b5aded735cb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:52.195108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-307556fc-149e-48dc-8d19-b5aded735cb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:52.204151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-307556fc-149e-48dc-8d19-b5aded735cb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161100 Jul 18 16:52:52.204745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 229/459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:52 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:53.222395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ab732f94-46d5-4c8e-8fae-7549a35b1813 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:53.223004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ab732f94-46d5-4c8e-8fae-7549a35b1813 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:53.229508 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab732f94-46d5-4c8e-8fae-7549a35b1813 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.233055 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab732f94-46d5-4c8e-8fae-7549a35b1813 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.233055 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab732f94-46d5-4c8e-8fae-7549a35b1813 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:53.233055 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab732f94-46d5-4c8e-8fae-7549a35b1813 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:53.376128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ab732f94-46d5-4c8e-8fae-7549a35b1813 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:53.386356 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ab732f94-46d5-4c8e-8fae-7549a35b1813 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.168129 Jul 18 16:52:53.387467 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 231/460] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:53 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:54.410063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e0f2a7fe-87a8-4b5f-bab6-23454253e66e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:54.411036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e0f2a7fe-87a8-4b5f-bab6-23454253e66e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:54.419015 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0f2a7fe-87a8-4b5f-bab6-23454253e66e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.419554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0f2a7fe-87a8-4b5f-bab6-23454253e66e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:54.420333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0f2a7fe-87a8-4b5f-bab6-23454253e66e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:54.420797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0f2a7fe-87a8-4b5f-bab6-23454253e66e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:54.580200 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e0f2a7fe-87a8-4b5f-bab6-23454253e66e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:54.589701 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e0f2a7fe-87a8-4b5f-bab6-23454253e66e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.187840 Jul 18 16:52:54.590294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 230/461] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:54 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:55.608310 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-08d0930d-707e-4f53-b18c-27584fd3458e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:55.608922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-08d0930d-707e-4f53-b18c-27584fd3458e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:55.617128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-08d0930d-707e-4f53-b18c-27584fd3458e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:55.617565 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-08d0930d-707e-4f53-b18c-27584fd3458e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:55.618333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-08d0930d-707e-4f53-b18c-27584fd3458e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:55.618762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-08d0930d-707e-4f53-b18c-27584fd3458e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:55.770576 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-08d0930d-707e-4f53-b18c-27584fd3458e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:55.778776 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-08d0930d-707e-4f53-b18c-27584fd3458e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174291 Jul 18 16:52:55.779276 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 232/462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:55 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:52:56.797142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8eb9432a-c6f6-4c6e-8902-08a44f1be996 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:56.797745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8eb9432a-c6f6-4c6e-8902-08a44f1be996 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:56.805131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8eb9432a-c6f6-4c6e-8902-08a44f1be996 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:56.805584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8eb9432a-c6f6-4c6e-8902-08a44f1be996 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:56.806350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8eb9432a-c6f6-4c6e-8902-08a44f1be996 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:56.806782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8eb9432a-c6f6-4c6e-8902-08a44f1be996 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:56.953173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8eb9432a-c6f6-4c6e-8902-08a44f1be996 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:56.961803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8eb9432a-c6f6-4c6e-8902-08a44f1be996 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.168362 Jul 18 16:52:56.962392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 231/463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:56 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:57.988973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4af3d870-7bfc-4cfc-a90e-fb4fd9a8521a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:57.989583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4af3d870-7bfc-4cfc-a90e-fb4fd9a8521a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:57.996188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4af3d870-7bfc-4cfc-a90e-fb4fd9a8521a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:57.996626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4af3d870-7bfc-4cfc-a90e-fb4fd9a8521a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:57.997421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4af3d870-7bfc-4cfc-a90e-fb4fd9a8521a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:57.997849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4af3d870-7bfc-4cfc-a90e-fb4fd9a8521a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:58.145600 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4af3d870-7bfc-4cfc-a90e-fb4fd9a8521a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:58.153404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4af3d870-7bfc-4cfc-a90e-fb4fd9a8521a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.168291 Jul 18 16:52:58.153986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 233/464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:57 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:52:59.173870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d50c5ba0-d81e-454e-a10c-14948a8d92e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:52:59.174618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d50c5ba0-d81e-454e-a10c-14948a8d92e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:52:59.181442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d50c5ba0-d81e-454e-a10c-14948a8d92e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:59.181874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d50c5ba0-d81e-454e-a10c-14948a8d92e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:59.182637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d50c5ba0-d81e-454e-a10c-14948a8d92e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:52:59.183061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d50c5ba0-d81e-454e-a10c-14948a8d92e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:52:59.330990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d50c5ba0-d81e-454e-a10c-14948a8d92e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:52:59.339140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d50c5ba0-d81e-454e-a10c-14948a8d92e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.170494 Jul 18 16:52:59.339782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 232/465] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:52:59 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:00.361778 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1f676613-473b-4ce4-8567-7aab1976c3da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:00.362814 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1f676613-473b-4ce4-8567-7aab1976c3da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:00.370893 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1f676613-473b-4ce4-8567-7aab1976c3da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:00.371338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1f676613-473b-4ce4-8567-7aab1976c3da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:00.372542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1f676613-473b-4ce4-8567-7aab1976c3da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:00.373298 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1f676613-473b-4ce4-8567-7aab1976c3da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:00.513162 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1f676613-473b-4ce4-8567-7aab1976c3da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:00.521216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1f676613-473b-4ce4-8567-7aab1976c3da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163692 Jul 18 16:53:00.521799 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 234/466] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:00 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:01.538513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4a8660ff-2600-4684-9631-ab46767e409c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:01.539138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4a8660ff-2600-4684-9631-ab46767e409c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:01.550256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a8660ff-2600-4684-9631-ab46767e409c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:01.550745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a8660ff-2600-4684-9631-ab46767e409c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:01.551573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a8660ff-2600-4684-9631-ab46767e409c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:01.552019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a8660ff-2600-4684-9631-ab46767e409c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:01.708349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4a8660ff-2600-4684-9631-ab46767e409c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:01.716447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4a8660ff-2600-4684-9631-ab46767e409c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.181711 Jul 18 16:53:01.717030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 233/467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:01 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:02.733931 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3970a843-582e-4c05-9061-0274d9c537ce tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:02.734542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3970a843-582e-4c05-9061-0274d9c537ce tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:02.741799 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3970a843-582e-4c05-9061-0274d9c537ce tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:02.742321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3970a843-582e-4c05-9061-0274d9c537ce tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:02.743783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3970a843-582e-4c05-9061-0274d9c537ce tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:02.744357 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3970a843-582e-4c05-9061-0274d9c537ce tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:02.891798 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3970a843-582e-4c05-9061-0274d9c537ce tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:02.899848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3970a843-582e-4c05-9061-0274d9c537ce tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.169824 Jul 18 16:53:02.900428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 235/468] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:02 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:03.918570 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-61e77e0e-ed92-43fc-85f8-01de4aa76d7d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:03.919257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-61e77e0e-ed92-43fc-85f8-01de4aa76d7d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:03.926947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61e77e0e-ed92-43fc-85f8-01de4aa76d7d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:03.927534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61e77e0e-ed92-43fc-85f8-01de4aa76d7d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:03.928229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61e77e0e-ed92-43fc-85f8-01de4aa76d7d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:03.928671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61e77e0e-ed92-43fc-85f8-01de4aa76d7d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:04.082427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-61e77e0e-ed92-43fc-85f8-01de4aa76d7d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:04.090701 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-61e77e0e-ed92-43fc-85f8-01de4aa76d7d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.176363 Jul 18 16:53:04.091201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 234/469] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:03 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:05.108971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-35c7ba8a-907a-4064-97ec-787f2d7d52ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:05.109519 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-35c7ba8a-907a-4064-97ec-787f2d7d52ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:05.116653 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-35c7ba8a-907a-4064-97ec-787f2d7d52ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:05.117097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-35c7ba8a-907a-4064-97ec-787f2d7d52ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:05.117852 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-35c7ba8a-907a-4064-97ec-787f2d7d52ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:05.118278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-35c7ba8a-907a-4064-97ec-787f2d7d52ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:05.261427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-35c7ba8a-907a-4064-97ec-787f2d7d52ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:05.269904 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-35c7ba8a-907a-4064-97ec-787f2d7d52ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.164798 Jul 18 16:53:05.270484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 236/470] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:05 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:06.286778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-66e21130-d211-4877-9f3b-d0ca1d64f745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:06.287440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-66e21130-d211-4877-9f3b-d0ca1d64f745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:06.293943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66e21130-d211-4877-9f3b-d0ca1d64f745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:06.294389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66e21130-d211-4877-9f3b-d0ca1d64f745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:06.295160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66e21130-d211-4877-9f3b-d0ca1d64f745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:06.295631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66e21130-d211-4877-9f3b-d0ca1d64f745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:06.435954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-66e21130-d211-4877-9f3b-d0ca1d64f745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:06.444617 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-66e21130-d211-4877-9f3b-d0ca1d64f745 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161696 Jul 18 16:53:06.445192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 235/471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:06 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:07.462294 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1b74fe4a-6aa4-4019-b9e8-399067fe385f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:07.462893 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1b74fe4a-6aa4-4019-b9e8-399067fe385f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:07.469681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b74fe4a-6aa4-4019-b9e8-399067fe385f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.470333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b74fe4a-6aa4-4019-b9e8-399067fe385f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.471120 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b74fe4a-6aa4-4019-b9e8-399067fe385f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:07.471592 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b74fe4a-6aa4-4019-b9e8-399067fe385f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:07.610290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1b74fe4a-6aa4-4019-b9e8-399067fe385f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:07.617971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1b74fe4a-6aa4-4019-b9e8-399067fe385f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.159494 Jul 18 16:53:07.618539 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 237/472] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:08.636000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-95fdad77-9d32-4007-b4a3-9a584de97c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:08.636728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-95fdad77-9d32-4007-b4a3-9a584de97c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:08.643959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-95fdad77-9d32-4007-b4a3-9a584de97c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.644402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-95fdad77-9d32-4007-b4a3-9a584de97c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.645166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-95fdad77-9d32-4007-b4a3-9a584de97c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:08.645594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-95fdad77-9d32-4007-b4a3-9a584de97c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:08.780874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-95fdad77-9d32-4007-b4a3-9a584de97c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:08.788597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-95fdad77-9d32-4007-b4a3-9a584de97c7f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.156451 Jul 18 16:53:08.789843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 236/473] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:08 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:09.807805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6e7ae481-54ce-445d-b21d-0e7aef69a351 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:09.808361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6e7ae481-54ce-445d-b21d-0e7aef69a351 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:09.814802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e7ae481-54ce-445d-b21d-0e7aef69a351 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.815248 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e7ae481-54ce-445d-b21d-0e7aef69a351 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:09.816059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e7ae481-54ce-445d-b21d-0e7aef69a351 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:09.816494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e7ae481-54ce-445d-b21d-0e7aef69a351 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:09.956759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6e7ae481-54ce-445d-b21d-0e7aef69a351 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:09.964245 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6e7ae481-54ce-445d-b21d-0e7aef69a351 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161336 Jul 18 16:53:09.964812 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 238/474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:09 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:10.981096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8dc0c8ae-9f0d-46c1-b41f-4cac590b4141 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:10.981703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8dc0c8ae-9f0d-46c1-b41f-4cac590b4141 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:10.984066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:10.989700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dc0c8ae-9f0d-46c1-b41f-4cac590b4141 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.990144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dc0c8ae-9f0d-46c1-b41f-4cac590b4141 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.991001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dc0c8ae-9f0d-46c1-b41f-4cac590b4141 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:10.991479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dc0c8ae-9f0d-46c1-b41f-4cac590b4141 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:10.994271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:11.143750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8dc0c8ae-9f0d-46c1-b41f-4cac590b4141 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:11.151406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8dc0c8ae-9f0d-46c1-b41f-4cac590b4141 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174198 Jul 18 16:53:11.152016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 237/475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:10 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:12.169345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-22c33e27-c8d3-4480-b0a8-ab743e15d931 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:12.169907 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-22c33e27-c8d3-4480-b0a8-ab743e15d931 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:12.176409 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-22c33e27-c8d3-4480-b0a8-ab743e15d931 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.176930 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-22c33e27-c8d3-4480-b0a8-ab743e15d931 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.177625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-22c33e27-c8d3-4480-b0a8-ab743e15d931 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:12.178063 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-22c33e27-c8d3-4480-b0a8-ab743e15d931 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:12.320480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-22c33e27-c8d3-4480-b0a8-ab743e15d931 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:12.328178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-22c33e27-c8d3-4480-b0a8-ab743e15d931 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162699 Jul 18 16:53:12.328875 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 239/476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:12 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:13.346085 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9c4418cd-9e22-4a0b-bbc3-eb7e8c1146ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:13.346700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9c4418cd-9e22-4a0b-bbc3-eb7e8c1146ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:13.353870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c4418cd-9e22-4a0b-bbc3-eb7e8c1146ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.354320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c4418cd-9e22-4a0b-bbc3-eb7e8c1146ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.355258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c4418cd-9e22-4a0b-bbc3-eb7e8c1146ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:13.355723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c4418cd-9e22-4a0b-bbc3-eb7e8c1146ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:13.493022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9c4418cd-9e22-4a0b-bbc3-eb7e8c1146ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:13.501059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9c4418cd-9e22-4a0b-bbc3-eb7e8c1146ef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.159515 Jul 18 16:53:13.501618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 238/477] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:13 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:14.518261 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e77a5084-7d26-46ea-877e-fcb8df6ba72d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:14.518914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e77a5084-7d26-46ea-877e-fcb8df6ba72d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:14.520880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=26 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.528178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e77a5084-7d26-46ea-877e-fcb8df6ba72d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.528971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e77a5084-7d26-46ea-877e-fcb8df6ba72d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.530321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e77a5084-7d26-46ea-877e-fcb8df6ba72d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:14.531102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e77a5084-7d26-46ea-877e-fcb8df6ba72d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:14.539402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=78 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.686477 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e77a5084-7d26-46ea-877e-fcb8df6ba72d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:14.694450 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e77a5084-7d26-46ea-877e-fcb8df6ba72d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.180774 Jul 18 16:53:14.695007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 240/478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:14 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:15.712459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-08e0a94b-6ba2-49e5-86a0-1100e69ea7cc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:15.713073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-08e0a94b-6ba2-49e5-86a0-1100e69ea7cc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:15.720554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08e0a94b-6ba2-49e5-86a0-1100e69ea7cc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.721007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08e0a94b-6ba2-49e5-86a0-1100e69ea7cc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.721788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08e0a94b-6ba2-49e5-86a0-1100e69ea7cc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:15.722229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08e0a94b-6ba2-49e5-86a0-1100e69ea7cc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:15.862405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-08e0a94b-6ba2-49e5-86a0-1100e69ea7cc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:15.870133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-08e0a94b-6ba2-49e5-86a0-1100e69ea7cc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161535 Jul 18 16:53:15.870717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 239/479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:15 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:16.886865 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cdce6a64-08ae-42aa-be4f-09790e24de19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:16.887524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cdce6a64-08ae-42aa-be4f-09790e24de19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:16.895797 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cdce6a64-08ae-42aa-be4f-09790e24de19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.896249 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cdce6a64-08ae-42aa-be4f-09790e24de19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:16.897025 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cdce6a64-08ae-42aa-be4f-09790e24de19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:16.897461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cdce6a64-08ae-42aa-be4f-09790e24de19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:17.033661 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cdce6a64-08ae-42aa-be4f-09790e24de19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:17.041135 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cdce6a64-08ae-42aa-be4f-09790e24de19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158202 Jul 18 16:53:17.041695 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 241/480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:16 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:18.058643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a42ac927-2484-4c2e-a7fe-4154e8a7a05d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:18.059480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a42ac927-2484-4c2e-a7fe-4154e8a7a05d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:18.066803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a42ac927-2484-4c2e-a7fe-4154e8a7a05d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:18.067241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a42ac927-2484-4c2e-a7fe-4154e8a7a05d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.068027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a42ac927-2484-4c2e-a7fe-4154e8a7a05d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:18.068456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a42ac927-2484-4c2e-a7fe-4154e8a7a05d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:18.211150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a42ac927-2484-4c2e-a7fe-4154e8a7a05d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:18.219367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a42ac927-2484-4c2e-a7fe-4154e8a7a05d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163846 Jul 18 16:53:18.221303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 240/481] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:18 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:19.237636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a35405e0-732d-44e5-b5d1-57a645ebef13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:19.238190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a35405e0-732d-44e5-b5d1-57a645ebef13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:19.244427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a35405e0-732d-44e5-b5d1-57a645ebef13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.245197 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a35405e0-732d-44e5-b5d1-57a645ebef13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.246507 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a35405e0-732d-44e5-b5d1-57a645ebef13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:19.247167 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a35405e0-732d-44e5-b5d1-57a645ebef13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:19.401253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a35405e0-732d-44e5-b5d1-57a645ebef13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:19.409126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a35405e0-732d-44e5-b5d1-57a645ebef13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.176211 Jul 18 16:53:19.409754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 242/482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:19 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:20.426607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2841b150-fcc5-474e-9cd7-6fce80e61ea9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:20.427233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2841b150-fcc5-474e-9cd7-6fce80e61ea9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:20.434521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2841b150-fcc5-474e-9cd7-6fce80e61ea9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:20.439750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2841b150-fcc5-474e-9cd7-6fce80e61ea9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:20.439750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2841b150-fcc5-474e-9cd7-6fce80e61ea9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:20.439750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2841b150-fcc5-474e-9cd7-6fce80e61ea9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:20.576065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2841b150-fcc5-474e-9cd7-6fce80e61ea9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:20.585248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2841b150-fcc5-474e-9cd7-6fce80e61ea9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162378 Jul 18 16:53:20.585822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 241/483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:20 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:21.604233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f461a1c4-c39f-4707-8226-4bf3da5b6e1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:21.604851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f461a1c4-c39f-4707-8226-4bf3da5b6e1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:21.611477 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f461a1c4-c39f-4707-8226-4bf3da5b6e1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.611946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f461a1c4-c39f-4707-8226-4bf3da5b6e1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.612723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f461a1c4-c39f-4707-8226-4bf3da5b6e1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:21.613160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f461a1c4-c39f-4707-8226-4bf3da5b6e1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:21.750892 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f461a1c4-c39f-4707-8226-4bf3da5b6e1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:21.758586 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f461a1c4-c39f-4707-8226-4bf3da5b6e1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.159041 Jul 18 16:53:21.759151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 243/484] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:22.776691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-496452b1-1cec-4a1f-9deb-a96ecd4b2509 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:22.777296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-496452b1-1cec-4a1f-9deb-a96ecd4b2509 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:22.784099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-496452b1-1cec-4a1f-9deb-a96ecd4b2509 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.784545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-496452b1-1cec-4a1f-9deb-a96ecd4b2509 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.785312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-496452b1-1cec-4a1f-9deb-a96ecd4b2509 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:22.785752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-496452b1-1cec-4a1f-9deb-a96ecd4b2509 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:22.934754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-496452b1-1cec-4a1f-9deb-a96ecd4b2509 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:22.943237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-496452b1-1cec-4a1f-9deb-a96ecd4b2509 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.170317 Jul 18 16:53:22.943847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 242/485] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:23.960572 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bc2039b3-efa3-4f70-8c05-ff0cd5823424 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:23.961190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bc2039b3-efa3-4f70-8c05-ff0cd5823424 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:23.967981 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bc2039b3-efa3-4f70-8c05-ff0cd5823424 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:23.968495 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bc2039b3-efa3-4f70-8c05-ff0cd5823424 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:23.969269 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bc2039b3-efa3-4f70-8c05-ff0cd5823424 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:23.969703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bc2039b3-efa3-4f70-8c05-ff0cd5823424 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:24.107320 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bc2039b3-efa3-4f70-8c05-ff0cd5823424 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:24.115280 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bc2039b3-efa3-4f70-8c05-ff0cd5823424 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158554 Jul 18 16:53:24.115907 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 244/486] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:25.133722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-735093d7-3708-4502-b597-a48e2dd20eb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:25.134290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-735093d7-3708-4502-b597-a48e2dd20eb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:25.141639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-735093d7-3708-4502-b597-a48e2dd20eb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:25.142198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-735093d7-3708-4502-b597-a48e2dd20eb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:25.143001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-735093d7-3708-4502-b597-a48e2dd20eb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:25.143437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-735093d7-3708-4502-b597-a48e2dd20eb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:25.281899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-735093d7-3708-4502-b597-a48e2dd20eb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:25.289814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-735093d7-3708-4502-b597-a48e2dd20eb0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.159988 Jul 18 16:53:25.290391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 243/487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:26.306174 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b623b22b-eeb0-4d3b-90b3-cd6d5c7fc749 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:26.306779 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b623b22b-eeb0-4d3b-90b3-cd6d5c7fc749 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:26.314626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b623b22b-eeb0-4d3b-90b3-cd6d5c7fc749 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:26.315076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b623b22b-eeb0-4d3b-90b3-cd6d5c7fc749 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:26.315887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b623b22b-eeb0-4d3b-90b3-cd6d5c7fc749 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:26.316325 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b623b22b-eeb0-4d3b-90b3-cd6d5c7fc749 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:26.467137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b623b22b-eeb0-4d3b-90b3-cd6d5c7fc749 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:26.476117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b623b22b-eeb0-4d3b-90b3-cd6d5c7fc749 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.173729 Jul 18 16:53:26.476690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 245/488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:26 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:27.494190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a5d83d7d-3ecc-4fbc-8cbd-ddbd44cc1803 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:27.494784 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a5d83d7d-3ecc-4fbc-8cbd-ddbd44cc1803 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:27.503397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5d83d7d-3ecc-4fbc-8cbd-ddbd44cc1803 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:27.503867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5d83d7d-3ecc-4fbc-8cbd-ddbd44cc1803 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:27.504632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5d83d7d-3ecc-4fbc-8cbd-ddbd44cc1803 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:27.505063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5d83d7d-3ecc-4fbc-8cbd-ddbd44cc1803 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:27.646197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a5d83d7d-3ecc-4fbc-8cbd-ddbd44cc1803 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:27.654182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a5d83d7d-3ecc-4fbc-8cbd-ddbd44cc1803 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163770 Jul 18 16:53:27.655436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 244/489] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:28.672135 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8714f037-b191-4b18-b420-a01af9606d80 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:28.672780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8714f037-b191-4b18-b420-a01af9606d80 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:28.679418 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8714f037-b191-4b18-b420-a01af9606d80 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:28.679891 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8714f037-b191-4b18-b420-a01af9606d80 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:28.680740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8714f037-b191-4b18-b420-a01af9606d80 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:28.681189 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8714f037-b191-4b18-b420-a01af9606d80 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:28.852813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8714f037-b191-4b18-b420-a01af9606d80 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:28.861645 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8714f037-b191-4b18-b420-a01af9606d80 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.193529 Jul 18 16:53:28.862233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 246/490] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:28 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:29.880136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-684cd4f4-d41f-462d-9d96-41e8be9a20a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:29.880803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-684cd4f4-d41f-462d-9d96-41e8be9a20a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:29.887886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-684cd4f4-d41f-462d-9d96-41e8be9a20a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:29.888332 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-684cd4f4-d41f-462d-9d96-41e8be9a20a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:29.889800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-684cd4f4-d41f-462d-9d96-41e8be9a20a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:29.890255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-684cd4f4-d41f-462d-9d96-41e8be9a20a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:30.031354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-684cd4f4-d41f-462d-9d96-41e8be9a20a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:30.039134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-684cd4f4-d41f-462d-9d96-41e8be9a20a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162931 Jul 18 16:53:30.039734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 245/491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:29 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:31.062140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-03f89c68-01c3-435f-9030-56d8fee32b1e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:31.062750 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-03f89c68-01c3-435f-9030-56d8fee32b1e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:31.069128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03f89c68-01c3-435f-9030-56d8fee32b1e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:31.069562 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03f89c68-01c3-435f-9030-56d8fee32b1e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:31.070328 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03f89c68-01c3-435f-9030-56d8fee32b1e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:31.070753 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03f89c68-01c3-435f-9030-56d8fee32b1e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:31.226021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-03f89c68-01c3-435f-9030-56d8fee32b1e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:31.234968 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-03f89c68-01c3-435f-9030-56d8fee32b1e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.177527 Jul 18 16:53:31.235613 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 247/492] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:31 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:32.252775 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cb5612b7-6a6b-408e-9db2-f24ecf3a19ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:32.262281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cb5612b7-6a6b-408e-9db2-f24ecf3a19ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:32.262281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb5612b7-6a6b-408e-9db2-f24ecf3a19ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:32.262281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb5612b7-6a6b-408e-9db2-f24ecf3a19ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:32.262281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb5612b7-6a6b-408e-9db2-f24ecf3a19ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:32.262666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb5612b7-6a6b-408e-9db2-f24ecf3a19ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:32.398282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb5612b7-6a6b-408e-9db2-f24ecf3a19ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:32.406842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cb5612b7-6a6b-408e-9db2-f24ecf3a19ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.157843 Jul 18 16:53:32.407436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 246/493] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:32 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:33.432288 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0de15891-a60f-4379-88c0-2f6b330dc0bd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:33.433204 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0de15891-a60f-4379-88c0-2f6b330dc0bd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:33.440903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0de15891-a60f-4379-88c0-2f6b330dc0bd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:33.441341 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0de15891-a60f-4379-88c0-2f6b330dc0bd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:33.442187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0de15891-a60f-4379-88c0-2f6b330dc0bd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:33.442617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0de15891-a60f-4379-88c0-2f6b330dc0bd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:33.584300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0de15891-a60f-4379-88c0-2f6b330dc0bd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:33.592887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0de15891-a60f-4379-88c0-2f6b330dc0bd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.164199 Jul 18 16:53:33.593544 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 248/494] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:34.611010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7560fb45-a8a1-4d12-9961-ca5eeab4b5e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:34.611636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7560fb45-a8a1-4d12-9961-ca5eeab4b5e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:34.618241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7560fb45-a8a1-4d12-9961-ca5eeab4b5e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:34.618681 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7560fb45-a8a1-4d12-9961-ca5eeab4b5e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:34.619443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7560fb45-a8a1-4d12-9961-ca5eeab4b5e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:34.619908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7560fb45-a8a1-4d12-9961-ca5eeab4b5e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:34.777532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7560fb45-a8a1-4d12-9961-ca5eeab4b5e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:34.792171 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7560fb45-a8a1-4d12-9961-ca5eeab4b5e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.185161 Jul 18 16:53:34.795876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 247/495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:34 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:35.812584 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d2683bee-fc79-4465-9ac7-e4c447eb5c7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:35.813141 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d2683bee-fc79-4465-9ac7-e4c447eb5c7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:35.819867 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d2683bee-fc79-4465-9ac7-e4c447eb5c7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:35.820304 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d2683bee-fc79-4465-9ac7-e4c447eb5c7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:35.821061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d2683bee-fc79-4465-9ac7-e4c447eb5c7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:35.821489 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d2683bee-fc79-4465-9ac7-e4c447eb5c7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:35.961376 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d2683bee-fc79-4465-9ac7-e4c447eb5c7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:35.969765 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d2683bee-fc79-4465-9ac7-e4c447eb5c7e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161026 Jul 18 16:53:35.970515 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 249/496] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:35 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:36.988943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-93b1f24f-b8f1-4274-a2c3-3013d41bc1e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:36.989648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-93b1f24f-b8f1-4274-a2c3-3013d41bc1e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:37.004527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93b1f24f-b8f1-4274-a2c3-3013d41bc1e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.005335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93b1f24f-b8f1-4274-a2c3-3013d41bc1e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.006715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93b1f24f-b8f1-4274-a2c3-3013d41bc1e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:37.007534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93b1f24f-b8f1-4274-a2c3-3013d41bc1e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:37.165881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-93b1f24f-b8f1-4274-a2c3-3013d41bc1e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:37.178067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-93b1f24f-b8f1-4274-a2c3-3013d41bc1e2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.194103 Jul 18 16:53:37.178776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 248/497] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:36 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:38.206369 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-110dd0ba-587c-4431-9a28-0b3ebd288c56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:38.206917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-110dd0ba-587c-4431-9a28-0b3ebd288c56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:38.213943 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-110dd0ba-587c-4431-9a28-0b3ebd288c56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:38.214417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-110dd0ba-587c-4431-9a28-0b3ebd288c56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:38.215204 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-110dd0ba-587c-4431-9a28-0b3ebd288c56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:38.215683 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-110dd0ba-587c-4431-9a28-0b3ebd288c56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:38.382461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-110dd0ba-587c-4431-9a28-0b3ebd288c56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:38.397002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-110dd0ba-587c-4431-9a28-0b3ebd288c56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.194236 Jul 18 16:53:38.398062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 250/498] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:38 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:39.415242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-18ff7299-be2b-4739-a869-4d94892c3c8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:39.415963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-18ff7299-be2b-4739-a869-4d94892c3c8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:39.424075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18ff7299-be2b-4739-a869-4d94892c3c8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:39.424530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18ff7299-be2b-4739-a869-4d94892c3c8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:39.425318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18ff7299-be2b-4739-a869-4d94892c3c8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:39.425758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18ff7299-be2b-4739-a869-4d94892c3c8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:39.824137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-18ff7299-be2b-4739-a869-4d94892c3c8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:39.835313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-18ff7299-be2b-4739-a869-4d94892c3c8c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.423729 Jul 18 16:53:39.836499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 249/499] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:39 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:40.854126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-42b24646-c1f7-4a92-8a62-5d7754966915 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:40.854750 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-42b24646-c1f7-4a92-8a62-5d7754966915 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:40.864908 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42b24646-c1f7-4a92-8a62-5d7754966915 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.865610 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42b24646-c1f7-4a92-8a62-5d7754966915 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:40.866532 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42b24646-c1f7-4a92-8a62-5d7754966915 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:40.867054 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-42b24646-c1f7-4a92-8a62-5d7754966915 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:41.033227 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-42b24646-c1f7-4a92-8a62-5d7754966915 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:41.041259 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-42b24646-c1f7-4a92-8a62-5d7754966915 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.190968 Jul 18 16:53:41.041838 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 251/500] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:40 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:42.061585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6f70bb81-a663-4df6-bb13-4ffdbcc63c63 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:42.062225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6f70bb81-a663-4df6-bb13-4ffdbcc63c63 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:42.065641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:42.075795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f70bb81-a663-4df6-bb13-4ffdbcc63c63 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.079853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f70bb81-a663-4df6-bb13-4ffdbcc63c63 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.079853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f70bb81-a663-4df6-bb13-4ffdbcc63c63 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:42.079853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f70bb81-a663-4df6-bb13-4ffdbcc63c63 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:42.086449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:42.248349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6f70bb81-a663-4df6-bb13-4ffdbcc63c63 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:42.256589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6f70bb81-a663-4df6-bb13-4ffdbcc63c63 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.200745 Jul 18 16:53:42.257568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 250/501] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:42 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:43.274301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9bf8cbb5-bac1-4a63-9b5b-0e5dc01ded24 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:43.274897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9bf8cbb5-bac1-4a63-9b5b-0e5dc01ded24 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:43.281964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9bf8cbb5-bac1-4a63-9b5b-0e5dc01ded24 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:43.282403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9bf8cbb5-bac1-4a63-9b5b-0e5dc01ded24 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:43.283168 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9bf8cbb5-bac1-4a63-9b5b-0e5dc01ded24 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:43.283626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9bf8cbb5-bac1-4a63-9b5b-0e5dc01ded24 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:43.425971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9bf8cbb5-bac1-4a63-9b5b-0e5dc01ded24 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:43.434668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9bf8cbb5-bac1-4a63-9b5b-0e5dc01ded24 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163513 Jul 18 16:53:43.436257 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 252/502] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:43 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:44.455309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c5acd642-586a-4027-b583-83a109b1a8a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:44.455937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c5acd642-586a-4027-b583-83a109b1a8a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:44.462794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5acd642-586a-4027-b583-83a109b1a8a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.463241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5acd642-586a-4027-b583-83a109b1a8a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.464057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5acd642-586a-4027-b583-83a109b1a8a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:44.464503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5acd642-586a-4027-b583-83a109b1a8a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:44.614745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c5acd642-586a-4027-b583-83a109b1a8a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:44.624531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c5acd642-586a-4027-b583-83a109b1a8a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.173085 Jul 18 16:53:44.625113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 251/503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:44 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:45.643984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cf219b7c-801e-48f1-827a-a73e05d8f067 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:45.644665 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cf219b7c-801e-48f1-827a-a73e05d8f067 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:45.646944 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=26 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:45.652511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf219b7c-801e-48f1-827a-a73e05d8f067 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.653505 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf219b7c-801e-48f1-827a-a73e05d8f067 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.654424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf219b7c-801e-48f1-827a-a73e05d8f067 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:45.654897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf219b7c-801e-48f1-827a-a73e05d8f067 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:45.658461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=78 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:45.816521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:53:45.817353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 16:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:53:45.833341 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cf219b7c-801e-48f1-827a-a73e05d8f067 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:45.843702 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cf219b7c-801e-48f1-827a-a73e05d8f067 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.204074 Jul 18 16:53:45.844344 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 253/504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:45 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:46.862405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8594ee12-183b-493f-9d86-0fd6d736de8d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:46.863003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8594ee12-183b-493f-9d86-0fd6d736de8d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:46.869909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8594ee12-183b-493f-9d86-0fd6d736de8d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.870353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8594ee12-183b-493f-9d86-0fd6d736de8d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:46.871821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8594ee12-183b-493f-9d86-0fd6d736de8d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:46.872261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8594ee12-183b-493f-9d86-0fd6d736de8d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:47.015350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8594ee12-183b-493f-9d86-0fd6d736de8d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:47.023767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8594ee12-183b-493f-9d86-0fd6d736de8d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165124 Jul 18 16:53:47.024433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 252/505] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:46 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:48.049421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-567bea59-7166-4584-a232-5ed6ac8595fe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:48.050083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-567bea59-7166-4584-a232-5ed6ac8595fe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:48.057070 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-567bea59-7166-4584-a232-5ed6ac8595fe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:48.057516 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-567bea59-7166-4584-a232-5ed6ac8595fe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:48.058289 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-567bea59-7166-4584-a232-5ed6ac8595fe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:48.059364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-567bea59-7166-4584-a232-5ed6ac8595fe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:48.221588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-567bea59-7166-4584-a232-5ed6ac8595fe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:48.231258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-567bea59-7166-4584-a232-5ed6ac8595fe tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.185469 Jul 18 16:53:48.231962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 254/506] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:48 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:49.250055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-609be05c-d088-4b61-a854-a234f64031c3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:49.250696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-609be05c-d088-4b61-a854-a234f64031c3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:49.257863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-609be05c-d088-4b61-a854-a234f64031c3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.258312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-609be05c-d088-4b61-a854-a234f64031c3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.259094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-609be05c-d088-4b61-a854-a234f64031c3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:49.259555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-609be05c-d088-4b61-a854-a234f64031c3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:49.444921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-609be05c-d088-4b61-a854-a234f64031c3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:49.455024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-609be05c-d088-4b61-a854-a234f64031c3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.210157 Jul 18 16:53:49.455652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 253/507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:49 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:50.473508 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6d00d4e6-e71d-4124-aa59-338192da2f03 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:50.474196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6d00d4e6-e71d-4124-aa59-338192da2f03 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:50.481482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6d00d4e6-e71d-4124-aa59-338192da2f03 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.482049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6d00d4e6-e71d-4124-aa59-338192da2f03 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.482865 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6d00d4e6-e71d-4124-aa59-338192da2f03 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:50.483277 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6d00d4e6-e71d-4124-aa59-338192da2f03 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:50.638193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6d00d4e6-e71d-4124-aa59-338192da2f03 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:50.646832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6d00d4e6-e71d-4124-aa59-338192da2f03 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.177654 Jul 18 16:53:50.647397 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 255/508] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:50 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:51.669731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9605362b-01ff-4559-9938-7de0afad5fdc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:51.670837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9605362b-01ff-4559-9938-7de0afad5fdc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:51.683518 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9605362b-01ff-4559-9938-7de0afad5fdc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.684313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9605362b-01ff-4559-9938-7de0afad5fdc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.685737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9605362b-01ff-4559-9938-7de0afad5fdc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:51.686490 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9605362b-01ff-4559-9938-7de0afad5fdc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:51.870072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9605362b-01ff-4559-9938-7de0afad5fdc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:51.879038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9605362b-01ff-4559-9938-7de0afad5fdc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.217591 Jul 18 16:53:51.879669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 254/509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:51 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:52.896714 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c46345a2-9c7c-40ef-940a-81df608251de tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:52.897380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c46345a2-9c7c-40ef-940a-81df608251de tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:52.905894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c46345a2-9c7c-40ef-940a-81df608251de tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:52.906385 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c46345a2-9c7c-40ef-940a-81df608251de tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:52.907199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c46345a2-9c7c-40ef-940a-81df608251de tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:52.907733 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c46345a2-9c7c-40ef-940a-81df608251de tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:53.063832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c46345a2-9c7c-40ef-940a-81df608251de tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:53.072555 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c46345a2-9c7c-40ef-940a-81df608251de tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.179587 Jul 18 16:53:53.073142 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 256/510] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:52 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:54.094506 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-366f784a-dd29-4977-a3d7-16f7b79471d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:54.095550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-366f784a-dd29-4977-a3d7-16f7b79471d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:54.107618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-366f784a-dd29-4977-a3d7-16f7b79471d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.108408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-366f784a-dd29-4977-a3d7-16f7b79471d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.109782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-366f784a-dd29-4977-a3d7-16f7b79471d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:54.110574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-366f784a-dd29-4977-a3d7-16f7b79471d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:54.283478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-366f784a-dd29-4977-a3d7-16f7b79471d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:54.291906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-366f784a-dd29-4977-a3d7-16f7b79471d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.204849 Jul 18 16:53:54.293188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 255/511] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:54 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:55.310241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d3ad216c-ba37-44d9-927f-0da940fd3c43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:55.310846 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d3ad216c-ba37-44d9-927f-0da940fd3c43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:55.316963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d3ad216c-ba37-44d9-927f-0da940fd3c43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.317434 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d3ad216c-ba37-44d9-927f-0da940fd3c43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.318199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d3ad216c-ba37-44d9-927f-0da940fd3c43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:55.318636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d3ad216c-ba37-44d9-927f-0da940fd3c43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:55.471962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d3ad216c-ba37-44d9-927f-0da940fd3c43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:55.481700 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d3ad216c-ba37-44d9-927f-0da940fd3c43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.176178 Jul 18 16:53:55.482410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 257/512] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:55 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:56.498944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f8d33c35-579f-412e-ae15-58e85b1500fd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:56.499594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f8d33c35-579f-412e-ae15-58e85b1500fd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:56.506527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8d33c35-579f-412e-ae15-58e85b1500fd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:56.506967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8d33c35-579f-412e-ae15-58e85b1500fd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:56.507779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8d33c35-579f-412e-ae15-58e85b1500fd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:56.508215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8d33c35-579f-412e-ae15-58e85b1500fd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:56.690354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f8d33c35-579f-412e-ae15-58e85b1500fd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:56.699272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f8d33c35-579f-412e-ae15-58e85b1500fd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.203900 Jul 18 16:53:56.700311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 256/513] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:56 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:53:57.718096 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1fe30b24-8008-48cc-bf38-e4bcf748ce89 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:57.718742 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1fe30b24-8008-48cc-bf38-e4bcf748ce89 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:57.725517 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fe30b24-8008-48cc-bf38-e4bcf748ce89 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:57.725954 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fe30b24-8008-48cc-bf38-e4bcf748ce89 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:57.726729 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fe30b24-8008-48cc-bf38-e4bcf748ce89 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:57.727159 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fe30b24-8008-48cc-bf38-e4bcf748ce89 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:57.879291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1fe30b24-8008-48cc-bf38-e4bcf748ce89 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:57.888264 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1fe30b24-8008-48cc-bf38-e4bcf748ce89 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174828 Jul 18 16:53:57.888847 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 258/514] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:57 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:53:58.906196 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3050cb35-698b-4a37-8c9c-140cbaae6f68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:53:58.906791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3050cb35-698b-4a37-8c9c-140cbaae6f68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:53:58.913943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3050cb35-698b-4a37-8c9c-140cbaae6f68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.914390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3050cb35-698b-4a37-8c9c-140cbaae6f68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:58.915198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3050cb35-698b-4a37-8c9c-140cbaae6f68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:53:58.915667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3050cb35-698b-4a37-8c9c-140cbaae6f68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:53:59.064621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3050cb35-698b-4a37-8c9c-140cbaae6f68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:53:59.073167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3050cb35-698b-4a37-8c9c-140cbaae6f68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.170392 Jul 18 16:53:59.074519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 257/515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:53:58 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:00.091280 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-106b081d-8e46-44e5-b62d-3862507ae7d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:00.091897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-106b081d-8e46-44e5-b62d-3862507ae7d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:00.098556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-106b081d-8e46-44e5-b62d-3862507ae7d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.099006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-106b081d-8e46-44e5-b62d-3862507ae7d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.099832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-106b081d-8e46-44e5-b62d-3862507ae7d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:00.100272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-106b081d-8e46-44e5-b62d-3862507ae7d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:00.282971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-106b081d-8e46-44e5-b62d-3862507ae7d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:00.291033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-106b081d-8e46-44e5-b62d-3862507ae7d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.204141 Jul 18 16:54:00.292465 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 259/516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:00 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:01.310348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-505537f9-42b8-4cea-beb5-62d7212b74bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:01.311008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-505537f9-42b8-4cea-beb5-62d7212b74bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:01.318055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-505537f9-42b8-4cea-beb5-62d7212b74bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.318502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-505537f9-42b8-4cea-beb5-62d7212b74bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.319320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-505537f9-42b8-4cea-beb5-62d7212b74bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:01.319788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-505537f9-42b8-4cea-beb5-62d7212b74bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:01.468746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-505537f9-42b8-4cea-beb5-62d7212b74bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:01.477325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-505537f9-42b8-4cea-beb5-62d7212b74bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171080 Jul 18 16:54:01.477932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 258/517] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:01 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:02.496097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a4785d71-ea1c-4ba0-b341-cb998e08397f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:02.496700 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a4785d71-ea1c-4ba0-b341-cb998e08397f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:02.503290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a4785d71-ea1c-4ba0-b341-cb998e08397f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.503787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a4785d71-ea1c-4ba0-b341-cb998e08397f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.504568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a4785d71-ea1c-4ba0-b341-cb998e08397f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:02.505007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a4785d71-ea1c-4ba0-b341-cb998e08397f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:02.648732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a4785d71-ea1c-4ba0-b341-cb998e08397f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:02.657424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a4785d71-ea1c-4ba0-b341-cb998e08397f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165852 Jul 18 16:54:02.658074 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 260/518] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:02 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:03.676645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fe595ad5-46b9-4119-9406-f637054a3297 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:03.677328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fe595ad5-46b9-4119-9406-f637054a3297 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:03.685727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe595ad5-46b9-4119-9406-f637054a3297 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.686201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe595ad5-46b9-4119-9406-f637054a3297 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.687027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe595ad5-46b9-4119-9406-f637054a3297 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:03.687466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe595ad5-46b9-4119-9406-f637054a3297 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:03.863024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe595ad5-46b9-4119-9406-f637054a3297 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:03.872312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fe595ad5-46b9-4119-9406-f637054a3297 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.200414 Jul 18 16:54:03.872901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 259/519] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:03 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:04.890425 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5edcf750-c2a4-4a3c-98f3-97eb332bbab5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:04.891076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5edcf750-c2a4-4a3c-98f3-97eb332bbab5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:04.897768 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5edcf750-c2a4-4a3c-98f3-97eb332bbab5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.898215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5edcf750-c2a4-4a3c-98f3-97eb332bbab5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:04.899029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5edcf750-c2a4-4a3c-98f3-97eb332bbab5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:04.899461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5edcf750-c2a4-4a3c-98f3-97eb332bbab5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:05.052434 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5edcf750-c2a4-4a3c-98f3-97eb332bbab5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:05.061168 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5edcf750-c2a4-4a3c-98f3-97eb332bbab5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.175071 Jul 18 16:54:05.061782 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 261/520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:04 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:06.079761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1260defa-72ec-45df-96cd-e2df536e2f42 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:06.080395 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1260defa-72ec-45df-96cd-e2df536e2f42 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:06.088093 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1260defa-72ec-45df-96cd-e2df536e2f42 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.088546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1260defa-72ec-45df-96cd-e2df536e2f42 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.089330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1260defa-72ec-45df-96cd-e2df536e2f42 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:06.089767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1260defa-72ec-45df-96cd-e2df536e2f42 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:06.253366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1260defa-72ec-45df-96cd-e2df536e2f42 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:06.262987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1260defa-72ec-45df-96cd-e2df536e2f42 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.186975 Jul 18 16:54:06.263618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 260/521] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:06 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:07.280862 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b205a849-e144-4c3b-96a5-71c8f4a0a2ec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:07.281762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b205a849-e144-4c3b-96a5-71c8f4a0a2ec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:07.288853 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b205a849-e144-4c3b-96a5-71c8f4a0a2ec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:07.289386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b205a849-e144-4c3b-96a5-71c8f4a0a2ec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:07.290272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b205a849-e144-4c3b-96a5-71c8f4a0a2ec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:07.291396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b205a849-e144-4c3b-96a5-71c8f4a0a2ec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:07.448632 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b205a849-e144-4c3b-96a5-71c8f4a0a2ec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:07.456476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b205a849-e144-4c3b-96a5-71c8f4a0a2ec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.179698 Jul 18 16:54:07.457057 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 262/522] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:08.475066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-709c0dc9-a091-4df6-a08a-50007beef54e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:08.475743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-709c0dc9-a091-4df6-a08a-50007beef54e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:08.483797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-709c0dc9-a091-4df6-a08a-50007beef54e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:08.484235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-709c0dc9-a091-4df6-a08a-50007beef54e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:08.485009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-709c0dc9-a091-4df6-a08a-50007beef54e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:08.485471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-709c0dc9-a091-4df6-a08a-50007beef54e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:08.643400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-709c0dc9-a091-4df6-a08a-50007beef54e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:08.653373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-709c0dc9-a091-4df6-a08a-50007beef54e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.182053 Jul 18 16:54:08.654054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 261/523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:08 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:09.671891 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2970ede8-a4eb-49b3-a2f2-32d17bef081f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:09.672569 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2970ede8-a4eb-49b3-a2f2-32d17bef081f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:09.679133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2970ede8-a4eb-49b3-a2f2-32d17bef081f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:09.680052 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2970ede8-a4eb-49b3-a2f2-32d17bef081f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:09.688380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2970ede8-a4eb-49b3-a2f2-32d17bef081f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:09.689012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2970ede8-a4eb-49b3-a2f2-32d17bef081f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:09.843159 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2970ede8-a4eb-49b3-a2f2-32d17bef081f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:09.851209 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2970ede8-a4eb-49b3-a2f2-32d17bef081f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.183449 Jul 18 16:54:09.851824 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 263/524] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:09 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:10.868584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ed747a6c-bd8a-4bdf-b719-484db01b76d9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:10.869252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ed747a6c-bd8a-4bdf-b719-484db01b76d9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:10.876386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed747a6c-bd8a-4bdf-b719-484db01b76d9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:10.876841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed747a6c-bd8a-4bdf-b719-484db01b76d9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:10.877609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed747a6c-bd8a-4bdf-b719-484db01b76d9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:10.878052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed747a6c-bd8a-4bdf-b719-484db01b76d9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:11.017356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ed747a6c-bd8a-4bdf-b719-484db01b76d9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:11.034142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ed747a6c-bd8a-4bdf-b719-484db01b76d9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.169361 Jul 18 16:54:11.034936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 262/525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:10 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:12.051989 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-97bc116e-5641-4bc0-970a-5fd13866b920 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:12.052602 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-97bc116e-5641-4bc0-970a-5fd13866b920 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:12.061649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97bc116e-5641-4bc0-970a-5fd13866b920 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.062269 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97bc116e-5641-4bc0-970a-5fd13866b920 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:12.063216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97bc116e-5641-4bc0-970a-5fd13866b920 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:12.063887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97bc116e-5641-4bc0-970a-5fd13866b920 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:12.233530 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-97bc116e-5641-4bc0-970a-5fd13866b920 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:12.241595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-97bc116e-5641-4bc0-970a-5fd13866b920 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.193384 Jul 18 16:54:12.242193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 264/526] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:12 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:13.260030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a5cdddd4-1bc7-4e1e-9ec4-00d223755706 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:13.260794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a5cdddd4-1bc7-4e1e-9ec4-00d223755706 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:13.263536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:13.269017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5cdddd4-1bc7-4e1e-9ec4-00d223755706 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:13.269471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5cdddd4-1bc7-4e1e-9ec4-00d223755706 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:13.270261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5cdddd4-1bc7-4e1e-9ec4-00d223755706 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:13.270698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5cdddd4-1bc7-4e1e-9ec4-00d223755706 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:13.273877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:13.423067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a5cdddd4-1bc7-4e1e-9ec4-00d223755706 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:13.432592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a5cdddd4-1bc7-4e1e-9ec4-00d223755706 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.175886 Jul 18 16:54:13.433193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 263/527] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:13 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:14.310784 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:54:14.311473 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 16:54:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:54:14.450480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e1d2765c-073c-4cb7-abce-1bf9df2b4e01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:14.451179 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e1d2765c-073c-4cb7-abce-1bf9df2b4e01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:14.457774 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e1d2765c-073c-4cb7-abce-1bf9df2b4e01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.458218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e1d2765c-073c-4cb7-abce-1bf9df2b4e01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:14.458991 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e1d2765c-073c-4cb7-abce-1bf9df2b4e01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:14.459424 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e1d2765c-073c-4cb7-abce-1bf9df2b4e01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:14.600379 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e1d2765c-073c-4cb7-abce-1bf9df2b4e01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:14.609093 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e1d2765c-073c-4cb7-abce-1bf9df2b4e01 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163156 Jul 18 16:54:14.609671 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 265/528] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:14 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:15.627887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-174e680a-f851-4afa-a816-f6013846bccb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:15.628525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-174e680a-f851-4afa-a816-f6013846bccb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:15.636396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-174e680a-f851-4afa-a816-f6013846bccb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:15.636969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-174e680a-f851-4afa-a816-f6013846bccb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.638166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-174e680a-f851-4afa-a816-f6013846bccb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:15.638892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-174e680a-f851-4afa-a816-f6013846bccb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:15.789296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-174e680a-f851-4afa-a816-f6013846bccb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:15.798160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-174e680a-f851-4afa-a816-f6013846bccb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174391 Jul 18 16:54:15.798740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 264/529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:15 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:16.815710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-565a5809-3d10-4b79-a8de-52819049f850 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:16.816381 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-565a5809-3d10-4b79-a8de-52819049f850 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:16.818502 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=26 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:16.824080 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-565a5809-3d10-4b79-a8de-52819049f850 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.824599 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-565a5809-3d10-4b79-a8de-52819049f850 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.825429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-565a5809-3d10-4b79-a8de-52819049f850 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:16.825870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-565a5809-3d10-4b79-a8de-52819049f850 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:16.828960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=78 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:16.965103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-565a5809-3d10-4b79-a8de-52819049f850 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:16.972781 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-565a5809-3d10-4b79-a8de-52819049f850 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160983 Jul 18 16:54:16.973340 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 266/530] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:16 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:17.991650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-34e2121b-ec47-46f0-ab19-42376c514665 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:17.992256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-34e2121b-ec47-46f0-ab19-42376c514665 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:17.999747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-34e2121b-ec47-46f0-ab19-42376c514665 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:18.000200 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-34e2121b-ec47-46f0-ab19-42376c514665 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:18.000977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-34e2121b-ec47-46f0-ab19-42376c514665 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:18.001414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-34e2121b-ec47-46f0-ab19-42376c514665 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:18.160500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-34e2121b-ec47-46f0-ab19-42376c514665 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:18.169028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-34e2121b-ec47-46f0-ab19-42376c514665 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.181369 Jul 18 16:54:18.169602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 265/531] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:17 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:19.187985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b0c91f86-3b02-465f-a8c8-e3a82fa4c6b0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:19.188635 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b0c91f86-3b02-465f-a8c8-e3a82fa4c6b0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:19.196747 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b0c91f86-3b02-465f-a8c8-e3a82fa4c6b0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:19.197270 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b0c91f86-3b02-465f-a8c8-e3a82fa4c6b0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:19.198236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b0c91f86-3b02-465f-a8c8-e3a82fa4c6b0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:19.198800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b0c91f86-3b02-465f-a8c8-e3a82fa4c6b0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:19.368072 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b0c91f86-3b02-465f-a8c8-e3a82fa4c6b0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:19.376808 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b0c91f86-3b02-465f-a8c8-e3a82fa4c6b0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.192952 Jul 18 16:54:19.377561 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 267/532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:19 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:20.401060 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-40e14319-3b57-4374-a92b-8efe4d891fc3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:20.401609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-40e14319-3b57-4374-a92b-8efe4d891fc3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:20.408576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40e14319-3b57-4374-a92b-8efe4d891fc3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:20.409027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40e14319-3b57-4374-a92b-8efe4d891fc3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:20.409818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40e14319-3b57-4374-a92b-8efe4d891fc3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:20.410259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40e14319-3b57-4374-a92b-8efe4d891fc3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:20.550873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-40e14319-3b57-4374-a92b-8efe4d891fc3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:20.558669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-40e14319-3b57-4374-a92b-8efe4d891fc3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162601 Jul 18 16:54:20.559230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 266/533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:20 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:21.577010 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-05b64f5d-9b5e-4bf9-afce-7ff6dacb5f8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:21.577650 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-05b64f5d-9b5e-4bf9-afce-7ff6dacb5f8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:21.584373 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-05b64f5d-9b5e-4bf9-afce-7ff6dacb5f8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:21.584819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-05b64f5d-9b5e-4bf9-afce-7ff6dacb5f8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:21.585595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-05b64f5d-9b5e-4bf9-afce-7ff6dacb5f8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:21.586695 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-05b64f5d-9b5e-4bf9-afce-7ff6dacb5f8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:21.722415 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-05b64f5d-9b5e-4bf9-afce-7ff6dacb5f8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:21.731124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-05b64f5d-9b5e-4bf9-afce-7ff6dacb5f8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158844 Jul 18 16:54:21.731812 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 268/534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:22.749003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a018fe99-272d-404c-ac9d-3f6f26a67bb4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:22.749625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a018fe99-272d-404c-ac9d-3f6f26a67bb4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:22.756189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a018fe99-272d-404c-ac9d-3f6f26a67bb4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.756633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a018fe99-272d-404c-ac9d-3f6f26a67bb4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.757413 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a018fe99-272d-404c-ac9d-3f6f26a67bb4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:22.758329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a018fe99-272d-404c-ac9d-3f6f26a67bb4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:22.893510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a018fe99-272d-404c-ac9d-3f6f26a67bb4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:22.901750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a018fe99-272d-404c-ac9d-3f6f26a67bb4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.156573 Jul 18 16:54:22.902333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 267/535] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:23.918422 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-10427e5a-fbc7-423c-b446-e6194db9d72c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:23.919012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-10427e5a-fbc7-423c-b446-e6194db9d72c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:23.925218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-10427e5a-fbc7-423c-b446-e6194db9d72c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:23.925668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-10427e5a-fbc7-423c-b446-e6194db9d72c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:23.926434 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-10427e5a-fbc7-423c-b446-e6194db9d72c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:23.926901 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-10427e5a-fbc7-423c-b446-e6194db9d72c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:24.072191 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-10427e5a-fbc7-423c-b446-e6194db9d72c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:24.079808 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-10427e5a-fbc7-423c-b446-e6194db9d72c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165163 Jul 18 16:54:24.080378 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 269/536] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:25.099058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4b9f6423-64d7-47a4-8e24-9944e974f0b4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:25.099877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4b9f6423-64d7-47a4-8e24-9944e974f0b4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:25.107188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b9f6423-64d7-47a4-8e24-9944e974f0b4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:25.107679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b9f6423-64d7-47a4-8e24-9944e974f0b4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:25.108458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b9f6423-64d7-47a4-8e24-9944e974f0b4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:25.108896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b9f6423-64d7-47a4-8e24-9944e974f0b4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:25.247055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4b9f6423-64d7-47a4-8e24-9944e974f0b4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:25.254584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4b9f6423-64d7-47a4-8e24-9944e974f0b4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160513 Jul 18 16:54:25.255136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 268/537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:26.272730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7d1e0fe3-e456-4b7a-aa92-118364967fb6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:26.274030 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7d1e0fe3-e456-4b7a-aa92-118364967fb6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:26.280044 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d1e0fe3-e456-4b7a-aa92-118364967fb6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:26.280489 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d1e0fe3-e456-4b7a-aa92-118364967fb6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:26.281249 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d1e0fe3-e456-4b7a-aa92-118364967fb6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:26.281674 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d1e0fe3-e456-4b7a-aa92-118364967fb6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:26.415822 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7d1e0fe3-e456-4b7a-aa92-118364967fb6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:26.424042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7d1e0fe3-e456-4b7a-aa92-118364967fb6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.155187 Jul 18 16:54:26.424636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 270/538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:26 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:26.510537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:54:26.510745 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 16:54:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:54:27.443687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d7bbe449-35d0-4d1a-b925-a85122cd315d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:27.444301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d7bbe449-35d0-4d1a-b925-a85122cd315d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:27.451431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7bbe449-35d0-4d1a-b925-a85122cd315d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:27.451910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7bbe449-35d0-4d1a-b925-a85122cd315d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:27.452715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7bbe449-35d0-4d1a-b925-a85122cd315d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:27.453140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7bbe449-35d0-4d1a-b925-a85122cd315d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:27.592891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d7bbe449-35d0-4d1a-b925-a85122cd315d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:27.602189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d7bbe449-35d0-4d1a-b925-a85122cd315d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161199 Jul 18 16:54:27.602717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 269/539] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:28.620175 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0f72baab-0a01-45d3-b6e9-7dc9008f1157 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:28.620779 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0f72baab-0a01-45d3-b6e9-7dc9008f1157 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:28.627744 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f72baab-0a01-45d3-b6e9-7dc9008f1157 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:28.628202 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f72baab-0a01-45d3-b6e9-7dc9008f1157 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:28.629068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f72baab-0a01-45d3-b6e9-7dc9008f1157 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:28.629519 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f72baab-0a01-45d3-b6e9-7dc9008f1157 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:28.767921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0f72baab-0a01-45d3-b6e9-7dc9008f1157 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:28.776156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0f72baab-0a01-45d3-b6e9-7dc9008f1157 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160431 Jul 18 16:54:28.777262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 271/540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:28 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:29.794615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5068ef05-6a1d-4f42-af2c-5ea0e4cf10aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:29.795529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5068ef05-6a1d-4f42-af2c-5ea0e4cf10aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:29.802338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5068ef05-6a1d-4f42-af2c-5ea0e4cf10aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:29.802791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5068ef05-6a1d-4f42-af2c-5ea0e4cf10aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:29.804450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5068ef05-6a1d-4f42-af2c-5ea0e4cf10aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:29.805052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5068ef05-6a1d-4f42-af2c-5ea0e4cf10aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:29.942573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5068ef05-6a1d-4f42-af2c-5ea0e4cf10aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:29.950597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5068ef05-6a1d-4f42-af2c-5ea0e4cf10aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160202 Jul 18 16:54:29.951155 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 270/541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:29 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:30.968220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b26cce22-be4d-46dc-8a15-aaa5de65c71d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:30.968819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b26cce22-be4d-46dc-8a15-aaa5de65c71d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:30.974982 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b26cce22-be4d-46dc-8a15-aaa5de65c71d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:30.975961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b26cce22-be4d-46dc-8a15-aaa5de65c71d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:30.977068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b26cce22-be4d-46dc-8a15-aaa5de65c71d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:30.977654 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b26cce22-be4d-46dc-8a15-aaa5de65c71d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:31.111308 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b26cce22-be4d-46dc-8a15-aaa5de65c71d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:31.119572 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b26cce22-be4d-46dc-8a15-aaa5de65c71d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.155154 Jul 18 16:54:31.120130 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 272/542] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:30 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:32.137652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7addc138-cdfc-4249-8705-caa1d8bceb13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:32.138253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7addc138-cdfc-4249-8705-caa1d8bceb13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:32.144962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7addc138-cdfc-4249-8705-caa1d8bceb13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:32.145460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7addc138-cdfc-4249-8705-caa1d8bceb13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:32.146195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7addc138-cdfc-4249-8705-caa1d8bceb13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:32.146625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7addc138-cdfc-4249-8705-caa1d8bceb13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:32.309133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7addc138-cdfc-4249-8705-caa1d8bceb13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:32.318467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7addc138-cdfc-4249-8705-caa1d8bceb13 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.184907 Jul 18 16:54:32.319051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 271/543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:32 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:54:33.339419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dceda63f-6d86-4aa4-b247-02fec790063e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:33.340169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dceda63f-6d86-4aa4-b247-02fec790063e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:33.346438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dceda63f-6d86-4aa4-b247-02fec790063e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:33.346878 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dceda63f-6d86-4aa4-b247-02fec790063e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:33.347716 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dceda63f-6d86-4aa4-b247-02fec790063e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:33.348152 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dceda63f-6d86-4aa4-b247-02fec790063e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:33.498535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dceda63f-6d86-4aa4-b247-02fec790063e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:33.516869 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dceda63f-6d86-4aa4-b247-02fec790063e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.182067 Jul 18 16:54:33.517486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 273/544] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:34.534062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-acf37a5b-e7eb-451e-a880-90c57f9f91e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:34.534664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-acf37a5b-e7eb-451e-a880-90c57f9f91e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:34.547947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-acf37a5b-e7eb-451e-a880-90c57f9f91e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:34.548399 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-acf37a5b-e7eb-451e-a880-90c57f9f91e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:34.549183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-acf37a5b-e7eb-451e-a880-90c57f9f91e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:34.549623 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-acf37a5b-e7eb-451e-a880-90c57f9f91e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:34.711181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-acf37a5b-e7eb-451e-a880-90c57f9f91e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:34.719759 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-acf37a5b-e7eb-451e-a880-90c57f9f91e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.189474 Jul 18 16:54:34.720430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 272/545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:34 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:35.737733 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-15964a90-c6b2-4f43-bf16-8e3254c37211 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:35.738348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-15964a90-c6b2-4f43-bf16-8e3254c37211 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:35.745437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-15964a90-c6b2-4f43-bf16-8e3254c37211 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:35.745909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-15964a90-c6b2-4f43-bf16-8e3254c37211 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:35.746756 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-15964a90-c6b2-4f43-bf16-8e3254c37211 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:35.747194 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-15964a90-c6b2-4f43-bf16-8e3254c37211 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:35.907171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-15964a90-c6b2-4f43-bf16-8e3254c37211 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:35.916115 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-15964a90-c6b2-4f43-bf16-8e3254c37211 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.182158 Jul 18 16:54:35.916692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 274/546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:35 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:36.938365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bd83fdda-5e95-485c-bc5f-1ac62d6a7762 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:36.939001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bd83fdda-5e95-485c-bc5f-1ac62d6a7762 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:36.946053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd83fdda-5e95-485c-bc5f-1ac62d6a7762 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:36.946532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd83fdda-5e95-485c-bc5f-1ac62d6a7762 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:36.947305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd83fdda-5e95-485c-bc5f-1ac62d6a7762 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:36.947768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd83fdda-5e95-485c-bc5f-1ac62d6a7762 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:37.098341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bd83fdda-5e95-485c-bc5f-1ac62d6a7762 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:37.106802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bd83fdda-5e95-485c-bc5f-1ac62d6a7762 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.172259 Jul 18 16:54:37.107388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 273/547] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:36 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:38.131319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-09eaf87e-48ae-496c-8d82-750e059d0ba0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:38.132528 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-09eaf87e-48ae-496c-8d82-750e059d0ba0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:38.140025 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09eaf87e-48ae-496c-8d82-750e059d0ba0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.140672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09eaf87e-48ae-496c-8d82-750e059d0ba0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.141682 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09eaf87e-48ae-496c-8d82-750e059d0ba0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:38.142421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09eaf87e-48ae-496c-8d82-750e059d0ba0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:38.311052 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-09eaf87e-48ae-496c-8d82-750e059d0ba0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:38.320845 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-09eaf87e-48ae-496c-8d82-750e059d0ba0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.193459 Jul 18 16:54:38.321431 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 275/548] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:38 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:39.338640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ba6c766c-6e1b-445a-8d8e-975841fa7ff4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:39.339257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ba6c766c-6e1b-445a-8d8e-975841fa7ff4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:39.346804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba6c766c-6e1b-445a-8d8e-975841fa7ff4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.347247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba6c766c-6e1b-445a-8d8e-975841fa7ff4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.348076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba6c766c-6e1b-445a-8d8e-975841fa7ff4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:39.348626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba6c766c-6e1b-445a-8d8e-975841fa7ff4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:39.510324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ba6c766c-6e1b-445a-8d8e-975841fa7ff4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:39.525357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ba6c766c-6e1b-445a-8d8e-975841fa7ff4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.190368 Jul 18 16:54:39.526379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 274/549] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:39 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:40.543785 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3e889076-6a0b-4808-9965-e73a3dbb5b66 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:40.544467 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3e889076-6a0b-4808-9965-e73a3dbb5b66 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:40.550710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e889076-6a0b-4808-9965-e73a3dbb5b66 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:40.551160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e889076-6a0b-4808-9965-e73a3dbb5b66 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:40.551947 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e889076-6a0b-4808-9965-e73a3dbb5b66 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:40.553584 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e889076-6a0b-4808-9965-e73a3dbb5b66 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:40.706138 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3e889076-6a0b-4808-9965-e73a3dbb5b66 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:40.714423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3e889076-6a0b-4808-9965-e73a3dbb5b66 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174530 Jul 18 16:54:40.715006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 276/550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:40 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:41.731482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-70b91fb0-806f-48a4-88ee-dfa74a1ddaec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:41.732516 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-70b91fb0-806f-48a4-88ee-dfa74a1ddaec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:41.739291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70b91fb0-806f-48a4-88ee-dfa74a1ddaec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:41.739778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70b91fb0-806f-48a4-88ee-dfa74a1ddaec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:41.743058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70b91fb0-806f-48a4-88ee-dfa74a1ddaec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:41.743058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70b91fb0-806f-48a4-88ee-dfa74a1ddaec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:41.894344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-70b91fb0-806f-48a4-88ee-dfa74a1ddaec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:41.902558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-70b91fb0-806f-48a4-88ee-dfa74a1ddaec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.175284 Jul 18 16:54:41.903147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 275/551] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:41 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:42.919991 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9dbd18b7-e46e-49d0-ad69-e48958adff48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:42.920601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9dbd18b7-e46e-49d0-ad69-e48958adff48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:42.927930 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9dbd18b7-e46e-49d0-ad69-e48958adff48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.929114 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9dbd18b7-e46e-49d0-ad69-e48958adff48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:42.930054 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9dbd18b7-e46e-49d0-ad69-e48958adff48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:42.930588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9dbd18b7-e46e-49d0-ad69-e48958adff48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:43.078601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9dbd18b7-e46e-49d0-ad69-e48958adff48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:43.087638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9dbd18b7-e46e-49d0-ad69-e48958adff48 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171323 Jul 18 16:54:43.088203 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 277/552] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:42 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:43.812800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:54:43.813062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 16:54:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:54:44.106804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-abd46fd9-17c4-41e7-92e2-deea464050aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:44.107605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-abd46fd9-17c4-41e7-92e2-deea464050aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:44.109910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:44.114992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abd46fd9-17c4-41e7-92e2-deea464050aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.119825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abd46fd9-17c4-41e7-92e2-deea464050aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.119825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abd46fd9-17c4-41e7-92e2-deea464050aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:44.119825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abd46fd9-17c4-41e7-92e2-deea464050aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:44.120244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:44.263723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-abd46fd9-17c4-41e7-92e2-deea464050aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:44.272868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-abd46fd9-17c4-41e7-92e2-deea464050aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.169903 Jul 18 16:54:44.273637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 276/553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:44 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:45.290672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cbfd3dba-e4aa-4865-af31-c66b5f219e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:45.291278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cbfd3dba-e4aa-4865-af31-c66b5f219e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:45.297597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbfd3dba-e4aa-4865-af31-c66b5f219e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.298041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbfd3dba-e4aa-4865-af31-c66b5f219e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.298805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbfd3dba-e4aa-4865-af31-c66b5f219e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:45.299236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbfd3dba-e4aa-4865-af31-c66b5f219e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:45.450997 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cbfd3dba-e4aa-4865-af31-c66b5f219e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:45.461318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cbfd3dba-e4aa-4865-af31-c66b5f219e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174963 Jul 18 16:54:45.461897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 278/554] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:45 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:46.479424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7207a4dc-d7cc-469b-8ef5-878c4adac46b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:46.480191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7207a4dc-d7cc-469b-8ef5-878c4adac46b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:46.487351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7207a4dc-d7cc-469b-8ef5-878c4adac46b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.487829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7207a4dc-d7cc-469b-8ef5-878c4adac46b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.488715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7207a4dc-d7cc-469b-8ef5-878c4adac46b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:46.489217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7207a4dc-d7cc-469b-8ef5-878c4adac46b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:46.637548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7207a4dc-d7cc-469b-8ef5-878c4adac46b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:46.646076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7207a4dc-d7cc-469b-8ef5-878c4adac46b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171179 Jul 18 16:54:46.647062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 277/555] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:46 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:47.663865 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5633ed6a-537c-4d2a-a101-648c00372433 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:47.664506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5633ed6a-537c-4d2a-a101-648c00372433 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:47.666368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=26 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:47.671330 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5633ed6a-537c-4d2a-a101-648c00372433 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:47.671803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5633ed6a-537c-4d2a-a101-648c00372433 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.672561 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5633ed6a-537c-4d2a-a101-648c00372433 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:47.672983 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5633ed6a-537c-4d2a-a101-648c00372433 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:47.675917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=78 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:47.824572 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5633ed6a-537c-4d2a-a101-648c00372433 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:47.832893 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5633ed6a-537c-4d2a-a101-648c00372433 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.173851 Jul 18 16:54:47.834401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 279/556] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:47 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:48.849923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-695a444e-287c-4b15-9ee7-40163e234d3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:48.850523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-695a444e-287c-4b15-9ee7-40163e234d3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:48.857525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-695a444e-287c-4b15-9ee7-40163e234d3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.858109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-695a444e-287c-4b15-9ee7-40163e234d3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:48.858837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-695a444e-287c-4b15-9ee7-40163e234d3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:48.859324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-695a444e-287c-4b15-9ee7-40163e234d3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:49.018231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-695a444e-287c-4b15-9ee7-40163e234d3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:49.027861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-695a444e-287c-4b15-9ee7-40163e234d3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.181673 Jul 18 16:54:49.028442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 278/557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:48 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:50.046059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-39d91c75-690b-4c85-bc35-3cd269a6395e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:50.046914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-39d91c75-690b-4c85-bc35-3cd269a6395e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:50.054932 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-39d91c75-690b-4c85-bc35-3cd269a6395e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.055431 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-39d91c75-690b-4c85-bc35-3cd269a6395e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.056390 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-39d91c75-690b-4c85-bc35-3cd269a6395e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:50.057648 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-39d91c75-690b-4c85-bc35-3cd269a6395e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:50.203292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-39d91c75-690b-4c85-bc35-3cd269a6395e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:50.211378 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-39d91c75-690b-4c85-bc35-3cd269a6395e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.169932 Jul 18 16:54:50.211985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 280/558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:50 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:51.229687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-13c70305-15ef-4d88-86cb-ac2e5a42e0f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:51.230262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-13c70305-15ef-4d88-86cb-ac2e5a42e0f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:51.237008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13c70305-15ef-4d88-86cb-ac2e5a42e0f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.237459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13c70305-15ef-4d88-86cb-ac2e5a42e0f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.238231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13c70305-15ef-4d88-86cb-ac2e5a42e0f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:51.238666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13c70305-15ef-4d88-86cb-ac2e5a42e0f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:51.373585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-13c70305-15ef-4d88-86cb-ac2e5a42e0f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:51.381057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-13c70305-15ef-4d88-86cb-ac2e5a42e0f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.155352 Jul 18 16:54:51.381612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 279/559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:51 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:52.397681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5e3f09a8-7a3d-4e48-840a-eee57b27e481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:52.398291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5e3f09a8-7a3d-4e48-840a-eee57b27e481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:52.404680 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5e3f09a8-7a3d-4e48-840a-eee57b27e481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.405130 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5e3f09a8-7a3d-4e48-840a-eee57b27e481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:52.405896 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5e3f09a8-7a3d-4e48-840a-eee57b27e481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:52.406334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5e3f09a8-7a3d-4e48-840a-eee57b27e481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:52.541861 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5e3f09a8-7a3d-4e48-840a-eee57b27e481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:52.549336 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5e3f09a8-7a3d-4e48-840a-eee57b27e481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.155755 Jul 18 16:54:52.549895 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 281/560] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:52 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:53.566622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-aec38696-fd31-4ee9-9975-c83905be555f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:53.567787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-aec38696-fd31-4ee9-9975-c83905be555f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:53.574496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aec38696-fd31-4ee9-9975-c83905be555f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:53.575190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aec38696-fd31-4ee9-9975-c83905be555f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.575993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aec38696-fd31-4ee9-9975-c83905be555f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:53.576438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aec38696-fd31-4ee9-9975-c83905be555f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:53.729321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-aec38696-fd31-4ee9-9975-c83905be555f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:53.737017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-aec38696-fd31-4ee9-9975-c83905be555f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174447 Jul 18 16:54:53.737611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 280/561] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:53 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:54.754272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e87f8eb3-6b36-4149-9b94-4a5fb74d552a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:54.757643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e87f8eb3-6b36-4149-9b94-4a5fb74d552a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:54.762124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e87f8eb3-6b36-4149-9b94-4a5fb74d552a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.762568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e87f8eb3-6b36-4149-9b94-4a5fb74d552a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.763323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e87f8eb3-6b36-4149-9b94-4a5fb74d552a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:54.763782 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e87f8eb3-6b36-4149-9b94-4a5fb74d552a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:54.904229 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e87f8eb3-6b36-4149-9b94-4a5fb74d552a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:54.912359 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e87f8eb3-6b36-4149-9b94-4a5fb74d552a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161971 Jul 18 16:54:54.912935 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 282/562] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:54 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:55.930002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bae1193c-7c03-44f5-9f75-e9598849c23c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:55.930601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bae1193c-7c03-44f5-9f75-e9598849c23c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:55.937579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bae1193c-7c03-44f5-9f75-e9598849c23c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.938023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bae1193c-7c03-44f5-9f75-e9598849c23c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:55.938802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bae1193c-7c03-44f5-9f75-e9598849c23c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:55.939247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bae1193c-7c03-44f5-9f75-e9598849c23c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:56.092854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bae1193c-7c03-44f5-9f75-e9598849c23c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:56.108256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bae1193c-7c03-44f5-9f75-e9598849c23c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.182427 Jul 18 16:54:56.108921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 281/563] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:55 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:57.127156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-89350393-66d6-437c-b068-ecc639125b21 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:57.127791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-89350393-66d6-437c-b068-ecc639125b21 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:57.135618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-89350393-66d6-437c-b068-ecc639125b21 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.136061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-89350393-66d6-437c-b068-ecc639125b21 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.136827 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-89350393-66d6-437c-b068-ecc639125b21 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:57.137253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-89350393-66d6-437c-b068-ecc639125b21 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:57.289049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-89350393-66d6-437c-b068-ecc639125b21 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:57.298169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-89350393-66d6-437c-b068-ecc639125b21 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.175466 Jul 18 16:54:57.298755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 283/564] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:57 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:58.320418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-328e918a-6efe-4078-957b-defaa776aa6c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:58.321041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-328e918a-6efe-4078-957b-defaa776aa6c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:58.327919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-328e918a-6efe-4078-957b-defaa776aa6c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:58.328367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-328e918a-6efe-4078-957b-defaa776aa6c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:58.329139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-328e918a-6efe-4078-957b-defaa776aa6c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:58.329577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-328e918a-6efe-4078-957b-defaa776aa6c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:58.477296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-328e918a-6efe-4078-957b-defaa776aa6c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:58.485251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-328e918a-6efe-4078-957b-defaa776aa6c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.170297 Jul 18 16:54:58.485824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 282/565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:58 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:54:59.502243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e7ab8e70-947b-4b01-822e-16a2d025d022 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:54:59.502899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e7ab8e70-947b-4b01-822e-16a2d025d022 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:54:59.509331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7ab8e70-947b-4b01-822e-16a2d025d022 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.509840 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7ab8e70-947b-4b01-822e-16a2d025d022 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.510618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7ab8e70-947b-4b01-822e-16a2d025d022 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:54:59.511048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7ab8e70-947b-4b01-822e-16a2d025d022 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:54:59.649110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e7ab8e70-947b-4b01-822e-16a2d025d022 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:54:59.656686 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e7ab8e70-947b-4b01-822e-16a2d025d022 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158309 Jul 18 16:54:59.657241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 284/566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:54:59 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:00.678903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-70d4a0d9-d494-4694-8544-cb533eea9723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:00.679511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-70d4a0d9-d494-4694-8544-cb533eea9723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:00.686239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70d4a0d9-d494-4694-8544-cb533eea9723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.686686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70d4a0d9-d494-4694-8544-cb533eea9723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.687450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70d4a0d9-d494-4694-8544-cb533eea9723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:00.687930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70d4a0d9-d494-4694-8544-cb533eea9723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:00.838556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-70d4a0d9-d494-4694-8544-cb533eea9723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:00.847285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-70d4a0d9-d494-4694-8544-cb533eea9723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.172850 Jul 18 16:55:00.848641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 283/567] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:00 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:01.866499 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2ecd2e57-5a37-4d17-ad3c-b49a1a61e8bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:01.867081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2ecd2e57-5a37-4d17-ad3c-b49a1a61e8bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:01.873712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ecd2e57-5a37-4d17-ad3c-b49a1a61e8bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.874164 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ecd2e57-5a37-4d17-ad3c-b49a1a61e8bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:01.874946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ecd2e57-5a37-4d17-ad3c-b49a1a61e8bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:01.875385 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ecd2e57-5a37-4d17-ad3c-b49a1a61e8bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:02.029973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2ecd2e57-5a37-4d17-ad3c-b49a1a61e8bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:02.038961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2ecd2e57-5a37-4d17-ad3c-b49a1a61e8bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.177151 Jul 18 16:55:02.039575 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 285/568] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:01 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:03.057257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f190fcd6-e8ba-4d7a-a288-f488fc6a313b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:03.057917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f190fcd6-e8ba-4d7a-a288-f488fc6a313b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:03.064785 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f190fcd6-e8ba-4d7a-a288-f488fc6a313b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:03.065242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f190fcd6-e8ba-4d7a-a288-f488fc6a313b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:03.066057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f190fcd6-e8ba-4d7a-a288-f488fc6a313b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:03.067363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f190fcd6-e8ba-4d7a-a288-f488fc6a313b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:03.211653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f190fcd6-e8ba-4d7a-a288-f488fc6a313b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:03.219654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f190fcd6-e8ba-4d7a-a288-f488fc6a313b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.166290 Jul 18 16:55:03.220247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 284/569] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:03 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:04.238308 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-654f008c-4a00-41a5-aa95-28f9db9c6926 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:04.239245 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-654f008c-4a00-41a5-aa95-28f9db9c6926 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:04.248670 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-654f008c-4a00-41a5-aa95-28f9db9c6926 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:04.249443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-654f008c-4a00-41a5-aa95-28f9db9c6926 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.250305 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-654f008c-4a00-41a5-aa95-28f9db9c6926 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:04.250678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-654f008c-4a00-41a5-aa95-28f9db9c6926 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:04.403453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-654f008c-4a00-41a5-aa95-28f9db9c6926 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:04.413046 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-654f008c-4a00-41a5-aa95-28f9db9c6926 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.179107 Jul 18 16:55:04.413639 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 286/570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:04 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:05.432211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1e070cc7-2ed5-4306-b5e1-a0fc4829dfc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:05.433012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1e070cc7-2ed5-4306-b5e1-a0fc4829dfc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:05.440385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e070cc7-2ed5-4306-b5e1-a0fc4829dfc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:05.440846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e070cc7-2ed5-4306-b5e1-a0fc4829dfc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:05.442175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e070cc7-2ed5-4306-b5e1-a0fc4829dfc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:05.442616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e070cc7-2ed5-4306-b5e1-a0fc4829dfc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:05.649006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1e070cc7-2ed5-4306-b5e1-a0fc4829dfc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:05.659312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1e070cc7-2ed5-4306-b5e1-a0fc4829dfc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.231045 Jul 18 16:55:05.661199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 285/571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:05 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:06.686324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bd310ce2-f199-485f-9c02-986f8ecd2ae6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:06.686916 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bd310ce2-f199-485f-9c02-986f8ecd2ae6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:06.694240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd310ce2-f199-485f-9c02-986f8ecd2ae6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.694741 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd310ce2-f199-485f-9c02-986f8ecd2ae6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.695692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd310ce2-f199-485f-9c02-986f8ecd2ae6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:06.696212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd310ce2-f199-485f-9c02-986f8ecd2ae6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:06.837546 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bd310ce2-f199-485f-9c02-986f8ecd2ae6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:06.845682 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bd310ce2-f199-485f-9c02-986f8ecd2ae6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163517 Jul 18 16:55:06.846247 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 287/572] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:06 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:07.865609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9d6df9b0-b6c6-4976-a995-afe4e09e0907 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:07.866228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9d6df9b0-b6c6-4976-a995-afe4e09e0907 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:07.873132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d6df9b0-b6c6-4976-a995-afe4e09e0907 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:07.873569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d6df9b0-b6c6-4976-a995-afe4e09e0907 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:07.874348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d6df9b0-b6c6-4976-a995-afe4e09e0907 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:07.874778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d6df9b0-b6c6-4976-a995-afe4e09e0907 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:08.028107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9d6df9b0-b6c6-4976-a995-afe4e09e0907 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:08.036951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9d6df9b0-b6c6-4976-a995-afe4e09e0907 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.175385 Jul 18 16:55:08.037718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 286/573] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:09.067050 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-96963c27-33ea-4b8b-b22e-1f498884c3df tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:09.067831 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-96963c27-33ea-4b8b-b22e-1f498884c3df tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:09.074870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-96963c27-33ea-4b8b-b22e-1f498884c3df tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.075313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-96963c27-33ea-4b8b-b22e-1f498884c3df tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.076124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-96963c27-33ea-4b8b-b22e-1f498884c3df tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:09.076561 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-96963c27-33ea-4b8b-b22e-1f498884c3df tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:09.241297 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-96963c27-33ea-4b8b-b22e-1f498884c3df tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:09.253934 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-96963c27-33ea-4b8b-b22e-1f498884c3df tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.191296 Jul 18 16:55:09.254803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 288/574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:09 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:10.273517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3abfeb13-3dde-4154-9665-001745f6a299 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:10.274201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3abfeb13-3dde-4154-9665-001745f6a299 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:10.281031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3abfeb13-3dde-4154-9665-001745f6a299 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.281481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3abfeb13-3dde-4154-9665-001745f6a299 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.282259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3abfeb13-3dde-4154-9665-001745f6a299 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:10.282698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3abfeb13-3dde-4154-9665-001745f6a299 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:10.445204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3abfeb13-3dde-4154-9665-001745f6a299 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:10.453180 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3abfeb13-3dde-4154-9665-001745f6a299 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.184547 Jul 18 16:55:10.453769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 287/575] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:10 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:11.472517 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-435012c0-509c-41b0-8666-f5c7a64fb7dd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:11.473538 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-435012c0-509c-41b0-8666-f5c7a64fb7dd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:11.480043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-435012c0-509c-41b0-8666-f5c7a64fb7dd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.480482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-435012c0-509c-41b0-8666-f5c7a64fb7dd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:11.481255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-435012c0-509c-41b0-8666-f5c7a64fb7dd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:11.481686 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-435012c0-509c-41b0-8666-f5c7a64fb7dd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:11.634077 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-435012c0-509c-41b0-8666-f5c7a64fb7dd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:11.642216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-435012c0-509c-41b0-8666-f5c7a64fb7dd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174557 Jul 18 16:55:11.642891 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 289/576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:11 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:12.664279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7f1e5e31-8217-44f5-932c-d18c7f41e723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:12.665359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7f1e5e31-8217-44f5-932c-d18c7f41e723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:12.678070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f1e5e31-8217-44f5-932c-d18c7f41e723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:12.678838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f1e5e31-8217-44f5-932c-d18c7f41e723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:12.680217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f1e5e31-8217-44f5-932c-d18c7f41e723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:12.680987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f1e5e31-8217-44f5-932c-d18c7f41e723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:12.833344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7f1e5e31-8217-44f5-932c-d18c7f41e723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:12.840573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7f1e5e31-8217-44f5-932c-d18c7f41e723 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.183282 Jul 18 16:55:12.840946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 288/577] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:12 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:13.861208 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ce33468a-8dbc-493a-a54e-680e0ac78df4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:13.862050 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ce33468a-8dbc-493a-a54e-680e0ac78df4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:13.873765 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ce33468a-8dbc-493a-a54e-680e0ac78df4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:13.874244 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ce33468a-8dbc-493a-a54e-680e0ac78df4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:13.875043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ce33468a-8dbc-493a-a54e-680e0ac78df4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:13.875483 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ce33468a-8dbc-493a-a54e-680e0ac78df4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:14.032576 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ce33468a-8dbc-493a-a54e-680e0ac78df4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:14.041704 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ce33468a-8dbc-493a-a54e-680e0ac78df4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.184498 Jul 18 16:55:14.042434 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 290/578] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:13 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:15.061294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c1507053-23d3-4021-8d25-f302c2ca9316 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:15.062031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c1507053-23d3-4021-8d25-f302c2ca9316 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:15.066026 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:15.074282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1507053-23d3-4021-8d25-f302c2ca9316 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:15.075077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1507053-23d3-4021-8d25-f302c2ca9316 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:15.076488 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1507053-23d3-4021-8d25-f302c2ca9316 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:15.077259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1507053-23d3-4021-8d25-f302c2ca9316 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:15.085493 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:15.248389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c1507053-23d3-4021-8d25-f302c2ca9316 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:15.257215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c1507053-23d3-4021-8d25-f302c2ca9316 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.201345 Jul 18 16:55:15.269054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 289/579] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:15 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:16.280794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7e2c24d0-14c8-4c98-a55c-62a38d138dc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:16.281460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7e2c24d0-14c8-4c98-a55c-62a38d138dc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:16.289431 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e2c24d0-14c8-4c98-a55c-62a38d138dc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.290020 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e2c24d0-14c8-4c98-a55c-62a38d138dc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.290854 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e2c24d0-14c8-4c98-a55c-62a38d138dc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:16.291411 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e2c24d0-14c8-4c98-a55c-62a38d138dc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:16.465617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7e2c24d0-14c8-4c98-a55c-62a38d138dc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:16.474590 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7e2c24d0-14c8-4c98-a55c-62a38d138dc1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.198019 Jul 18 16:55:16.475233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 291/580] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:16 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:17.493353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e19b1a8d-183a-44d6-adc4-389631633109 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:17.494126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e19b1a8d-183a-44d6-adc4-389631633109 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:17.503599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e19b1a8d-183a-44d6-adc4-389631633109 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:17.504311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e19b1a8d-183a-44d6-adc4-389631633109 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:17.505604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e19b1a8d-183a-44d6-adc4-389631633109 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:17.506294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e19b1a8d-183a-44d6-adc4-389631633109 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:17.685627 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e19b1a8d-183a-44d6-adc4-389631633109 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:17.695056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e19b1a8d-183a-44d6-adc4-389631633109 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.205583 Jul 18 16:55:17.695872 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 290/581] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:17 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:18.713668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6ed90f0c-966a-421d-bb6a-b417748b3332 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:18.714281 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6ed90f0c-966a-421d-bb6a-b417748b3332 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:18.716228 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=26 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:18.721740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ed90f0c-966a-421d-bb6a-b417748b3332 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:18.723409 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ed90f0c-966a-421d-bb6a-b417748b3332 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:18.723409 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ed90f0c-966a-421d-bb6a-b417748b3332 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:18.723641 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ed90f0c-966a-421d-bb6a-b417748b3332 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:18.726486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=78 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:18.871065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6ed90f0c-966a-421d-bb6a-b417748b3332 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:18.879224 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6ed90f0c-966a-421d-bb6a-b417748b3332 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.169446 Jul 18 16:55:18.879834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 292/582] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:18 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:19.898420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9632bcbb-e793-4799-94e6-dd81cb718260 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:19.899284 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9632bcbb-e793-4799-94e6-dd81cb718260 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:19.906935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9632bcbb-e793-4799-94e6-dd81cb718260 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:19.907415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9632bcbb-e793-4799-94e6-dd81cb718260 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:19.908625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9632bcbb-e793-4799-94e6-dd81cb718260 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:19.909109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9632bcbb-e793-4799-94e6-dd81cb718260 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:20.100939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9632bcbb-e793-4799-94e6-dd81cb718260 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:20.110558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9632bcbb-e793-4799-94e6-dd81cb718260 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.217270 Jul 18 16:55:20.111157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 291/583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:19 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:21.131324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-44ca613d-16b3-435e-a44b-f89aa41d09e6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:21.132056 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-44ca613d-16b3-435e-a44b-f89aa41d09e6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:21.138802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-44ca613d-16b3-435e-a44b-f89aa41d09e6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:21.139237 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-44ca613d-16b3-435e-a44b-f89aa41d09e6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:21.140165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-44ca613d-16b3-435e-a44b-f89aa41d09e6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:21.140603 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-44ca613d-16b3-435e-a44b-f89aa41d09e6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:21.551014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-44ca613d-16b3-435e-a44b-f89aa41d09e6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:21.559014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-44ca613d-16b3-435e-a44b-f89aa41d09e6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.432797 Jul 18 16:55:21.559626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 293/584] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:22.581035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-93a07106-8878-4c4e-8e2f-3b07a1baf743 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:22.582036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-93a07106-8878-4c4e-8e2f-3b07a1baf743 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:22.593020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93a07106-8878-4c4e-8e2f-3b07a1baf743 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.593775 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93a07106-8878-4c4e-8e2f-3b07a1baf743 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.595080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93a07106-8878-4c4e-8e2f-3b07a1baf743 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:22.595882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93a07106-8878-4c4e-8e2f-3b07a1baf743 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:22.781916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-93a07106-8878-4c4e-8e2f-3b07a1baf743 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:22.791088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-93a07106-8878-4c4e-8e2f-3b07a1baf743 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.216993 Jul 18 16:55:22.791711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 292/585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:23.812156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4c3c1c01-f678-4257-a001-18f43041d8b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:23.812779 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4c3c1c01-f678-4257-a001-18f43041d8b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:23.819368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c3c1c01-f678-4257-a001-18f43041d8b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:23.819852 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c3c1c01-f678-4257-a001-18f43041d8b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:23.820640 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c3c1c01-f678-4257-a001-18f43041d8b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:23.821072 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c3c1c01-f678-4257-a001-18f43041d8b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:23.995608 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4c3c1c01-f678-4257-a001-18f43041d8b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:23.996745 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4c3c1c01-f678-4257-a001-18f43041d8b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.189036 Jul 18 16:55:23.997335 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 294/586] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:25.015109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-71270730-9ac7-422b-b2da-195dcf1b6dd9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:25.015830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-71270730-9ac7-422b-b2da-195dcf1b6dd9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:25.023682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-71270730-9ac7-422b-b2da-195dcf1b6dd9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:25.024127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-71270730-9ac7-422b-b2da-195dcf1b6dd9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:25.024904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-71270730-9ac7-422b-b2da-195dcf1b6dd9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:25.025343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-71270730-9ac7-422b-b2da-195dcf1b6dd9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:25.205949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-71270730-9ac7-422b-b2da-195dcf1b6dd9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:25.214247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-71270730-9ac7-422b-b2da-195dcf1b6dd9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.203031 Jul 18 16:55:25.214838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 293/587] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:26.241730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-540d5c51-2bd4-4acd-9eb5-6486622bc7a5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:26.242316 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-540d5c51-2bd4-4acd-9eb5-6486622bc7a5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:26.248511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-540d5c51-2bd4-4acd-9eb5-6486622bc7a5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.248955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-540d5c51-2bd4-4acd-9eb5-6486622bc7a5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.249712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-540d5c51-2bd4-4acd-9eb5-6486622bc7a5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:26.250144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-540d5c51-2bd4-4acd-9eb5-6486622bc7a5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:26.394973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-540d5c51-2bd4-4acd-9eb5-6486622bc7a5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:26.403172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-540d5c51-2bd4-4acd-9eb5-6486622bc7a5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165225 Jul 18 16:55:26.403804 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 295/588] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:26 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:27.421160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-193bb022-641a-4290-81f1-5644e7638170 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:27.421792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-193bb022-641a-4290-81f1-5644e7638170 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:27.429333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-193bb022-641a-4290-81f1-5644e7638170 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:27.429803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-193bb022-641a-4290-81f1-5644e7638170 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:27.430554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-193bb022-641a-4290-81f1-5644e7638170 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:27.430979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-193bb022-641a-4290-81f1-5644e7638170 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:27.586438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-193bb022-641a-4290-81f1-5644e7638170 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:27.594486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-193bb022-641a-4290-81f1-5644e7638170 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.177414 Jul 18 16:55:27.595205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 294/589] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:55:28.620622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a0ad022a-0559-4e29-9fca-53cea8217558 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:28.621304 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a0ad022a-0559-4e29-9fca-53cea8217558 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:28.628577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0ad022a-0559-4e29-9fca-53cea8217558 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:28.629085 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0ad022a-0559-4e29-9fca-53cea8217558 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:28.629951 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0ad022a-0559-4e29-9fca-53cea8217558 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:28.630426 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0ad022a-0559-4e29-9fca-53cea8217558 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:28.781095 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a0ad022a-0559-4e29-9fca-53cea8217558 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:28.788791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a0ad022a-0559-4e29-9fca-53cea8217558 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.172009 Jul 18 16:55:28.789369 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 296/590] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:28 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:29.810347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-339ec4d1-e054-4cf9-a8f2-30a3390d0718 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:29.811052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-339ec4d1-e054-4cf9-a8f2-30a3390d0718 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:29.818744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-339ec4d1-e054-4cf9-a8f2-30a3390d0718 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.819198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-339ec4d1-e054-4cf9-a8f2-30a3390d0718 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.820029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-339ec4d1-e054-4cf9-a8f2-30a3390d0718 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:29.820475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-339ec4d1-e054-4cf9-a8f2-30a3390d0718 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:29.975953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-339ec4d1-e054-4cf9-a8f2-30a3390d0718 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:29.981240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-339ec4d1-e054-4cf9-a8f2-30a3390d0718 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174896 Jul 18 16:55:29.981797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 295/591] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:29 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:31.000568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec515e64-f25a-412d-8e3a-c4c74629e0e8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:31.001789 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ec515e64-f25a-412d-8e3a-c4c74629e0e8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:31.008366 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec515e64-f25a-412d-8e3a-c4c74629e0e8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:31.008811 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec515e64-f25a-412d-8e3a-c4c74629e0e8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:31.009587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec515e64-f25a-412d-8e3a-c4c74629e0e8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:31.010024 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec515e64-f25a-412d-8e3a-c4c74629e0e8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:31.160110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ec515e64-f25a-412d-8e3a-c4c74629e0e8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:31.168233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ec515e64-f25a-412d-8e3a-c4c74629e0e8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171657 Jul 18 16:55:31.168801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 297/592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:30 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:32.186184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7e676ba3-2033-4ed2-8100-2aef32ebd5ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:32.186801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7e676ba3-2033-4ed2-8100-2aef32ebd5ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:32.194288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e676ba3-2033-4ed2-8100-2aef32ebd5ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.194740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e676ba3-2033-4ed2-8100-2aef32ebd5ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.195643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e676ba3-2033-4ed2-8100-2aef32ebd5ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:32.196088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7e676ba3-2033-4ed2-8100-2aef32ebd5ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:32.339174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7e676ba3-2033-4ed2-8100-2aef32ebd5ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:32.347823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7e676ba3-2033-4ed2-8100-2aef32ebd5ee tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165375 Jul 18 16:55:32.348402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 296/593] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:32 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:33.365668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e1d38843-b7ae-4715-9179-33a8642ccdc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:33.366280 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e1d38843-b7ae-4715-9179-33a8642ccdc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:33.372350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e1d38843-b7ae-4715-9179-33a8642ccdc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:33.372790 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e1d38843-b7ae-4715-9179-33a8642ccdc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:33.373537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e1d38843-b7ae-4715-9179-33a8642ccdc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:33.373963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e1d38843-b7ae-4715-9179-33a8642ccdc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:33.510285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e1d38843-b7ae-4715-9179-33a8642ccdc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:33.518351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e1d38843-b7ae-4715-9179-33a8642ccdc2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.156697 Jul 18 16:55:33.518912 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 298/594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:34.535820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1d9eb49b-3999-4a5c-a3be-f3ba07496c59 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:34.536446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1d9eb49b-3999-4a5c-a3be-f3ba07496c59 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:34.542567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1d9eb49b-3999-4a5c-a3be-f3ba07496c59 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.543013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1d9eb49b-3999-4a5c-a3be-f3ba07496c59 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.543801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1d9eb49b-3999-4a5c-a3be-f3ba07496c59 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:34.544236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1d9eb49b-3999-4a5c-a3be-f3ba07496c59 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:34.698740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1d9eb49b-3999-4a5c-a3be-f3ba07496c59 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:34.708350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1d9eb49b-3999-4a5c-a3be-f3ba07496c59 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.176489 Jul 18 16:55:34.708930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 297/595] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:34 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:35.729858 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-47b4fe34-eb47-4761-a031-1261c08214a2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:35.730732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-47b4fe34-eb47-4761-a031-1261c08214a2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:35.738747 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-47b4fe34-eb47-4761-a031-1261c08214a2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.739311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-47b4fe34-eb47-4761-a031-1261c08214a2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.740187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-47b4fe34-eb47-4761-a031-1261c08214a2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:35.740699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-47b4fe34-eb47-4761-a031-1261c08214a2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:35.885750 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-47b4fe34-eb47-4761-a031-1261c08214a2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:35.893866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-47b4fe34-eb47-4761-a031-1261c08214a2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.169319 Jul 18 16:55:35.894439 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 299/596] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:35 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:36.911566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-063571a1-f5dd-4dc7-a93f-eefc0fafdbaf tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:36.912247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-063571a1-f5dd-4dc7-a93f-eefc0fafdbaf tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:36.921249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-063571a1-f5dd-4dc7-a93f-eefc0fafdbaf tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.921716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-063571a1-f5dd-4dc7-a93f-eefc0fafdbaf tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:36.923051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-063571a1-f5dd-4dc7-a93f-eefc0fafdbaf tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:36.925097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-063571a1-f5dd-4dc7-a93f-eefc0fafdbaf tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:37.098334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-063571a1-f5dd-4dc7-a93f-eefc0fafdbaf tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:37.112639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-063571a1-f5dd-4dc7-a93f-eefc0fafdbaf tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.205234 Jul 18 16:55:37.113449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 298/597] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:36 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:38.130405 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0f7e0c99-0465-44f1-a1f8-e8dcaf522e0b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:38.131004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0f7e0c99-0465-44f1-a1f8-e8dcaf522e0b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:38.137278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c99-0465-44f1-a1f8-e8dcaf522e0b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:38.137715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c99-0465-44f1-a1f8-e8dcaf522e0b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.138466 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c99-0465-44f1-a1f8-e8dcaf522e0b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:38.138893 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f7e0c99-0465-44f1-a1f8-e8dcaf522e0b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:38.283307 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0f7e0c99-0465-44f1-a1f8-e8dcaf522e0b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:38.291418 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0f7e0c99-0465-44f1-a1f8-e8dcaf522e0b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.164970 Jul 18 16:55:38.292072 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 300/598] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:38 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:39.309206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c15b03d0-ea4a-4e6c-88f7-8eaa1fa9bce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:39.309820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c15b03d0-ea4a-4e6c-88f7-8eaa1fa9bce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:39.316847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c15b03d0-ea4a-4e6c-88f7-8eaa1fa9bce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:39.317300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c15b03d0-ea4a-4e6c-88f7-8eaa1fa9bce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:39.318076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c15b03d0-ea4a-4e6c-88f7-8eaa1fa9bce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:39.318514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c15b03d0-ea4a-4e6c-88f7-8eaa1fa9bce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:39.457740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c15b03d0-ea4a-4e6c-88f7-8eaa1fa9bce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:39.464705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c15b03d0-ea4a-4e6c-88f7-8eaa1fa9bce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.159414 Jul 18 16:55:39.465278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 299/599] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:39 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:40.482715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8d1dd6e7-374f-4f25-a38c-70e237cdfb1b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:40.483377 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8d1dd6e7-374f-4f25-a38c-70e237cdfb1b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:40.490444 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8d1dd6e7-374f-4f25-a38c-70e237cdfb1b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.490866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8d1dd6e7-374f-4f25-a38c-70e237cdfb1b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.491659 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8d1dd6e7-374f-4f25-a38c-70e237cdfb1b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:40.492173 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8d1dd6e7-374f-4f25-a38c-70e237cdfb1b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:40.631806 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8d1dd6e7-374f-4f25-a38c-70e237cdfb1b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:40.639645 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8d1dd6e7-374f-4f25-a38c-70e237cdfb1b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160669 Jul 18 16:55:40.640236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 301/600] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:40 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:41.662318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9d6b68c8-1903-46d1-ad77-2c58ab57a0c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:41.662917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9d6b68c8-1903-46d1-ad77-2c58ab57a0c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:41.669710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d6b68c8-1903-46d1-ad77-2c58ab57a0c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.670216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d6b68c8-1903-46d1-ad77-2c58ab57a0c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.671088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d6b68c8-1903-46d1-ad77-2c58ab57a0c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:41.671640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9d6b68c8-1903-46d1-ad77-2c58ab57a0c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:41.810731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9d6b68c8-1903-46d1-ad77-2c58ab57a0c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:41.818950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9d6b68c8-1903-46d1-ad77-2c58ab57a0c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160413 Jul 18 16:55:41.819551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 300/601] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:41 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:42.838585 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2a7a42cd-a03f-4ff8-ba77-116e070c7c84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:42.839200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2a7a42cd-a03f-4ff8-ba77-116e070c7c84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:42.846163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2a7a42cd-a03f-4ff8-ba77-116e070c7c84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:42.846601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2a7a42cd-a03f-4ff8-ba77-116e070c7c84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:42.847371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2a7a42cd-a03f-4ff8-ba77-116e070c7c84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:42.847830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2a7a42cd-a03f-4ff8-ba77-116e070c7c84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:42.992360 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2a7a42cd-a03f-4ff8-ba77-116e070c7c84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:42.999928 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2a7a42cd-a03f-4ff8-ba77-116e070c7c84 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165201 Jul 18 16:55:43.000662 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 302/602] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:42 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:44.017924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-11774d02-6ed2-4211-a610-b20408c638c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:44.018629 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-11774d02-6ed2-4211-a610-b20408c638c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:44.025607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11774d02-6ed2-4211-a610-b20408c638c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:44.026054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11774d02-6ed2-4211-a610-b20408c638c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:44.026836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11774d02-6ed2-4211-a610-b20408c638c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:44.027281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11774d02-6ed2-4211-a610-b20408c638c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:44.177044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-11774d02-6ed2-4211-a610-b20408c638c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:44.184809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-11774d02-6ed2-4211-a610-b20408c638c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171597 Jul 18 16:55:44.185391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 301/603] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:44 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:45.202447 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f30f7cba-fc90-4d55-9d2c-eefa7f8a87c0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:45.203000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f30f7cba-fc90-4d55-9d2c-eefa7f8a87c0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:45.209549 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f30f7cba-fc90-4d55-9d2c-eefa7f8a87c0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.209998 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f30f7cba-fc90-4d55-9d2c-eefa7f8a87c0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.210780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f30f7cba-fc90-4d55-9d2c-eefa7f8a87c0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:45.211216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f30f7cba-fc90-4d55-9d2c-eefa7f8a87c0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:45.349221 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f30f7cba-fc90-4d55-9d2c-eefa7f8a87c0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:45.357172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f30f7cba-fc90-4d55-9d2c-eefa7f8a87c0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158658 Jul 18 16:55:45.357757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 303/604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:45 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:46.375612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-53546888-2d7f-49c6-9594-74a32ddf4a2f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:46.376936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-53546888-2d7f-49c6-9594-74a32ddf4a2f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:46.379164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:46.384421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53546888-2d7f-49c6-9594-74a32ddf4a2f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.384872 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53546888-2d7f-49c6-9594-74a32ddf4a2f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.385649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53546888-2d7f-49c6-9594-74a32ddf4a2f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:46.386095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53546888-2d7f-49c6-9594-74a32ddf4a2f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:46.389230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:46.544658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-53546888-2d7f-49c6-9594-74a32ddf4a2f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:46.553500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-53546888-2d7f-49c6-9594-74a32ddf4a2f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.182511 Jul 18 16:55:46.554069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 302/605] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:46 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:47.571992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b23e303b-9f76-41fb-b52d-8a85603b8d43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:47.572579 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b23e303b-9f76-41fb-b52d-8a85603b8d43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:47.578932 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b23e303b-9f76-41fb-b52d-8a85603b8d43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.579378 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b23e303b-9f76-41fb-b52d-8a85603b8d43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.580200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b23e303b-9f76-41fb-b52d-8a85603b8d43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:47.580633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b23e303b-9f76-41fb-b52d-8a85603b8d43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:47.727670 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b23e303b-9f76-41fb-b52d-8a85603b8d43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:47.736255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b23e303b-9f76-41fb-b52d-8a85603b8d43 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.168157 Jul 18 16:55:47.736816 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 304/606] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:47 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:48.755067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-afcbcd51-6201-4418-97b6-e426001efb68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:48.755840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-afcbcd51-6201-4418-97b6-e426001efb68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:48.762430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afcbcd51-6201-4418-97b6-e426001efb68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:48.762880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afcbcd51-6201-4418-97b6-e426001efb68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:48.763685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afcbcd51-6201-4418-97b6-e426001efb68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:48.764125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afcbcd51-6201-4418-97b6-e426001efb68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:48.914849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-afcbcd51-6201-4418-97b6-e426001efb68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:48.923253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-afcbcd51-6201-4418-97b6-e426001efb68 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.172567 Jul 18 16:55:48.924191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 303/607] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:48 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:49.940825 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a64dc171-dd81-439b-a339-15be7b2c6795 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:49.941401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a64dc171-dd81-439b-a339-15be7b2c6795 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:49.943294 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=26 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:49.948220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a64dc171-dd81-439b-a339-15be7b2c6795 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:49.948674 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a64dc171-dd81-439b-a339-15be7b2c6795 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:49.949431 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a64dc171-dd81-439b-a339-15be7b2c6795 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:49.949866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a64dc171-dd81-439b-a339-15be7b2c6795 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:49.954404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=78 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:50.084550 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a64dc171-dd81-439b-a339-15be7b2c6795 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:50.092461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a64dc171-dd81-439b-a339-15be7b2c6795 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.155577 Jul 18 16:55:50.093260 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 305/608] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:49 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:51.109623 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9a09ecb2-bf16-4ace-b15f-6aa094718588 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:51.110168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9a09ecb2-bf16-4ace-b15f-6aa094718588 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:51.117906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a09ecb2-bf16-4ace-b15f-6aa094718588 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.118349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a09ecb2-bf16-4ace-b15f-6aa094718588 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.119136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a09ecb2-bf16-4ace-b15f-6aa094718588 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:51.119593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a09ecb2-bf16-4ace-b15f-6aa094718588 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:51.259288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9a09ecb2-bf16-4ace-b15f-6aa094718588 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:51.268167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9a09ecb2-bf16-4ace-b15f-6aa094718588 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162466 Jul 18 16:55:51.268753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 304/609] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:51 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:52.285887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5f09b27f-ac02-4b4e-a219-7a403c4b873d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:52.286491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5f09b27f-ac02-4b4e-a219-7a403c4b873d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:52.292727 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5f09b27f-ac02-4b4e-a219-7a403c4b873d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.293169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5f09b27f-ac02-4b4e-a219-7a403c4b873d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.293922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5f09b27f-ac02-4b4e-a219-7a403c4b873d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:52.294420 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5f09b27f-ac02-4b4e-a219-7a403c4b873d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:52.429778 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5f09b27f-ac02-4b4e-a219-7a403c4b873d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:52.437979 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5f09b27f-ac02-4b4e-a219-7a403c4b873d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.155789 Jul 18 16:55:52.438552 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 306/610] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:52 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:53.455898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-80dade6c-a2bb-4bfd-8beb-4582b36a2d5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:53.456447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-80dade6c-a2bb-4bfd-8beb-4582b36a2d5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:53.463108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-80dade6c-a2bb-4bfd-8beb-4582b36a2d5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:53.463591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-80dade6c-a2bb-4bfd-8beb-4582b36a2d5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:53.464367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-80dade6c-a2bb-4bfd-8beb-4582b36a2d5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:53.464801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-80dade6c-a2bb-4bfd-8beb-4582b36a2d5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:53.614286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-80dade6c-a2bb-4bfd-8beb-4582b36a2d5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:53.622733 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-80dade6c-a2bb-4bfd-8beb-4582b36a2d5a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171236 Jul 18 16:55:53.623272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 305/611] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:53 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:54.647924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec72afc6-f8a4-4ee2-8cd3-2abb3f71a3c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:54.648813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ec72afc6-f8a4-4ee2-8cd3-2abb3f71a3c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:54.654882 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec72afc6-f8a4-4ee2-8cd3-2abb3f71a3c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:54.655326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec72afc6-f8a4-4ee2-8cd3-2abb3f71a3c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:54.656255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec72afc6-f8a4-4ee2-8cd3-2abb3f71a3c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:54.657518 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec72afc6-f8a4-4ee2-8cd3-2abb3f71a3c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:54.807472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ec72afc6-f8a4-4ee2-8cd3-2abb3f71a3c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:54.816412 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ec72afc6-f8a4-4ee2-8cd3-2abb3f71a3c9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.172222 Jul 18 16:55:54.816991 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 307/612] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:54 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:55.834040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-44165f06-251e-48aa-b3ce-e30d0129b7e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:55.834702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-44165f06-251e-48aa-b3ce-e30d0129b7e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:55.841434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-44165f06-251e-48aa-b3ce-e30d0129b7e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:55.841893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-44165f06-251e-48aa-b3ce-e30d0129b7e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:55.842803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-44165f06-251e-48aa-b3ce-e30d0129b7e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:55.843245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-44165f06-251e-48aa-b3ce-e30d0129b7e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:55.997958 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-44165f06-251e-48aa-b3ce-e30d0129b7e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:56.007030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-44165f06-251e-48aa-b3ce-e30d0129b7e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.176869 Jul 18 16:55:56.007642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 306/613] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:55 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:57.024257 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9c830fc6-0bb9-422b-a8e6-ed644104b94c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:57.024862 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9c830fc6-0bb9-422b-a8e6-ed644104b94c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:57.030928 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9c830fc6-0bb9-422b-a8e6-ed644104b94c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.031391 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9c830fc6-0bb9-422b-a8e6-ed644104b94c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.032163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9c830fc6-0bb9-422b-a8e6-ed644104b94c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:57.032626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9c830fc6-0bb9-422b-a8e6-ed644104b94c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:57.165443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9c830fc6-0bb9-422b-a8e6-ed644104b94c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:57.173334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9c830fc6-0bb9-422b-a8e6-ed644104b94c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.152955 Jul 18 16:55:57.174160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 308/614] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:57 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:58.191376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-61657e18-44d1-4f76-918f-c38ed19c6f97 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:58.191982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-61657e18-44d1-4f76-918f-c38ed19c6f97 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:58.198584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61657e18-44d1-4f76-918f-c38ed19c6f97 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.199031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61657e18-44d1-4f76-918f-c38ed19c6f97 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.199819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61657e18-44d1-4f76-918f-c38ed19c6f97 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:58.203801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61657e18-44d1-4f76-918f-c38ed19c6f97 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:58.340865 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-61657e18-44d1-4f76-918f-c38ed19c6f97 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:58.349329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-61657e18-44d1-4f76-918f-c38ed19c6f97 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162792 Jul 18 16:55:58.349898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 307/615] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:58 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:55:59.366472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-df8d0473-e598-4f65-8e3d-924d7a367997 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:55:59.367085 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-df8d0473-e598-4f65-8e3d-924d7a367997 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:55:59.373154 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df8d0473-e598-4f65-8e3d-924d7a367997 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:59.373596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df8d0473-e598-4f65-8e3d-924d7a367997 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.374354 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df8d0473-e598-4f65-8e3d-924d7a367997 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:55:59.374788 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df8d0473-e598-4f65-8e3d-924d7a367997 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:55:59.521604 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-df8d0473-e598-4f65-8e3d-924d7a367997 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:55:59.529309 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-df8d0473-e598-4f65-8e3d-924d7a367997 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.166716 Jul 18 16:55:59.529877 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 309/616] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:55:59 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:00.546647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-949ff124-4f72-4519-b385-be7772025e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:00.547354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-949ff124-4f72-4519-b385-be7772025e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:00.554255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-949ff124-4f72-4519-b385-be7772025e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:00.554697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-949ff124-4f72-4519-b385-be7772025e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:00.555460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-949ff124-4f72-4519-b385-be7772025e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:00.555923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-949ff124-4f72-4519-b385-be7772025e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:00.689914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-949ff124-4f72-4519-b385-be7772025e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:00.697505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-949ff124-4f72-4519-b385-be7772025e0f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.154832 Jul 18 16:56:00.698070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 308/617] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:00 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:01.715583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-60a99f96-3ee9-4bbe-b708-f87802b53e16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:01.716198 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-60a99f96-3ee9-4bbe-b708-f87802b53e16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:01.722994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60a99f96-3ee9-4bbe-b708-f87802b53e16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:01.723441 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60a99f96-3ee9-4bbe-b708-f87802b53e16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.724235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60a99f96-3ee9-4bbe-b708-f87802b53e16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:01.724669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60a99f96-3ee9-4bbe-b708-f87802b53e16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:01.860190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-60a99f96-3ee9-4bbe-b708-f87802b53e16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:01.867485 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-60a99f96-3ee9-4bbe-b708-f87802b53e16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.155857 Jul 18 16:56:01.868060 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 310/618] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:01 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:02.884878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3a397b4f-e65e-41f4-ba1c-8f2488168cc4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:02.885512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3a397b4f-e65e-41f4-ba1c-8f2488168cc4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:02.891786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a397b4f-e65e-41f4-ba1c-8f2488168cc4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.892229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a397b4f-e65e-41f4-ba1c-8f2488168cc4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:02.892987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a397b4f-e65e-41f4-ba1c-8f2488168cc4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:02.893421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a397b4f-e65e-41f4-ba1c-8f2488168cc4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:03.026749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3a397b4f-e65e-41f4-ba1c-8f2488168cc4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:03.035832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3a397b4f-e65e-41f4-ba1c-8f2488168cc4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.154744 Jul 18 16:56:03.036402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 309/619] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:02 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:04.055423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7e94304c-a16a-4216-84ed-5157c5dfb9e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:04.056381 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7e94304c-a16a-4216-84ed-5157c5dfb9e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:04.066617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e94304c-a16a-4216-84ed-5157c5dfb9e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.067073 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e94304c-a16a-4216-84ed-5157c5dfb9e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.067911 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e94304c-a16a-4216-84ed-5157c5dfb9e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:04.068350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e94304c-a16a-4216-84ed-5157c5dfb9e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:04.210821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7e94304c-a16a-4216-84ed-5157c5dfb9e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:04.218637 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7e94304c-a16a-4216-84ed-5157c5dfb9e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.168207 Jul 18 16:56:04.219204 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 311/620] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:04 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:05.236616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dffb40ff-35ea-40da-acb8-b8ab6ccd4842 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:05.237168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-dffb40ff-35ea-40da-acb8-b8ab6ccd4842 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:05.243804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dffb40ff-35ea-40da-acb8-b8ab6ccd4842 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:05.244250 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dffb40ff-35ea-40da-acb8-b8ab6ccd4842 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:05.245017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dffb40ff-35ea-40da-acb8-b8ab6ccd4842 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:05.245447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dffb40ff-35ea-40da-acb8-b8ab6ccd4842 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:05.381968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-dffb40ff-35ea-40da-acb8-b8ab6ccd4842 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:05.401696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dffb40ff-35ea-40da-acb8-b8ab6ccd4842 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.169072 Jul 18 16:56:05.402290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 310/621] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:05 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:06.420360 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-46183e9c-1d93-49ca-a933-22b758b16084 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:06.420964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-46183e9c-1d93-49ca-a933-22b758b16084 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:06.427665 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46183e9c-1d93-49ca-a933-22b758b16084 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:06.428117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46183e9c-1d93-49ca-a933-22b758b16084 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:06.428899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46183e9c-1d93-49ca-a933-22b758b16084 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:06.429333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46183e9c-1d93-49ca-a933-22b758b16084 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:06.567046 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-46183e9c-1d93-49ca-a933-22b758b16084 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:06.574698 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-46183e9c-1d93-49ca-a933-22b758b16084 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.159240 Jul 18 16:56:06.575277 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 312/622] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:06 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:07.592028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-188149cc-3a57-4575-afda-1a3b7d94abcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:07.592673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-188149cc-3a57-4575-afda-1a3b7d94abcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:07.600517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-188149cc-3a57-4575-afda-1a3b7d94abcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:07.600973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-188149cc-3a57-4575-afda-1a3b7d94abcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:07.601750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-188149cc-3a57-4575-afda-1a3b7d94abcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:07.602187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-188149cc-3a57-4575-afda-1a3b7d94abcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:07.752216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-188149cc-3a57-4575-afda-1a3b7d94abcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:07.753568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-188149cc-3a57-4575-afda-1a3b7d94abcc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165288 Jul 18 16:56:07.754154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 311/623] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:08.770421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-54a730ec-2b3f-4a11-a27a-f988290a5c3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:08.771020 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-54a730ec-2b3f-4a11-a27a-f988290a5c3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:08.777547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54a730ec-2b3f-4a11-a27a-f988290a5c3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.777999 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54a730ec-2b3f-4a11-a27a-f988290a5c3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:08.778765 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54a730ec-2b3f-4a11-a27a-f988290a5c3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:08.779211 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54a730ec-2b3f-4a11-a27a-f988290a5c3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:09.012478 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-54a730ec-2b3f-4a11-a27a-f988290a5c3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:09.020101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-54a730ec-2b3f-4a11-a27a-f988290a5c3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.253512 Jul 18 16:56:09.020674 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 313/624] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:08 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:09.913093 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:56:09.913704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 16:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:56:10.037933 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3a2e3d88-94b5-46b8-b228-1668fad6ae56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:10.038542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3a2e3d88-94b5-46b8-b228-1668fad6ae56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:10.045493 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a2e3d88-94b5-46b8-b228-1668fad6ae56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.045946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a2e3d88-94b5-46b8-b228-1668fad6ae56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:10.047245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a2e3d88-94b5-46b8-b228-1668fad6ae56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:10.047726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a2e3d88-94b5-46b8-b228-1668fad6ae56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:10.232131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3a2e3d88-94b5-46b8-b228-1668fad6ae56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:10.241285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3a2e3d88-94b5-46b8-b228-1668fad6ae56 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.207209 Jul 18 16:56:10.241869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 312/625] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:10 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:10.251442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:56:10.251646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 16:56:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 16:56:11.258319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ad3291bd-e0ff-45a3-a6d8-22b6b679591c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:11.258900 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ad3291bd-e0ff-45a3-a6d8-22b6b679591c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:11.265426 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad3291bd-e0ff-45a3-a6d8-22b6b679591c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:11.266029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad3291bd-e0ff-45a3-a6d8-22b6b679591c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:11.266792 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad3291bd-e0ff-45a3-a6d8-22b6b679591c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:11.267223 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad3291bd-e0ff-45a3-a6d8-22b6b679591c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:11.413308 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ad3291bd-e0ff-45a3-a6d8-22b6b679591c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:11.421081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ad3291bd-e0ff-45a3-a6d8-22b6b679591c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.166618 Jul 18 16:56:11.422282 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 314/626] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:11 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:12.439682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-52c41eeb-d230-4f51-ac6e-8b65cf42c845 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:12.440300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-52c41eeb-d230-4f51-ac6e-8b65cf42c845 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:12.447266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52c41eeb-d230-4f51-ac6e-8b65cf42c845 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:12.447787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52c41eeb-d230-4f51-ac6e-8b65cf42c845 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:12.448514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52c41eeb-d230-4f51-ac6e-8b65cf42c845 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:12.449061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52c41eeb-d230-4f51-ac6e-8b65cf42c845 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:12.596617 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-52c41eeb-d230-4f51-ac6e-8b65cf42c845 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:12.604681 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-52c41eeb-d230-4f51-ac6e-8b65cf42c845 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.169394 Jul 18 16:56:12.605252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 313/627] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:12 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:13.622352 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a8e2c77e-acb7-4dbb-ac2f-d42ac250426c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:13.623162 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a8e2c77e-acb7-4dbb-ac2f-d42ac250426c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:13.629942 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8e2c77e-acb7-4dbb-ac2f-d42ac250426c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:13.629942 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8e2c77e-acb7-4dbb-ac2f-d42ac250426c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:13.630506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8e2c77e-acb7-4dbb-ac2f-d42ac250426c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:13.630939 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8e2c77e-acb7-4dbb-ac2f-d42ac250426c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:13.784171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a8e2c77e-acb7-4dbb-ac2f-d42ac250426c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:13.791940 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a8e2c77e-acb7-4dbb-ac2f-d42ac250426c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.173319 Jul 18 16:56:13.792405 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 315/628] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:13 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:14.810172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-89112810-eb8e-4005-839f-2ed660f6ac3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:14.810764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-89112810-eb8e-4005-839f-2ed660f6ac3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:14.818380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-89112810-eb8e-4005-839f-2ed660f6ac3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:14.818863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-89112810-eb8e-4005-839f-2ed660f6ac3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:14.819676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-89112810-eb8e-4005-839f-2ed660f6ac3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:14.820115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-89112810-eb8e-4005-839f-2ed660f6ac3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:14.955897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-89112810-eb8e-4005-839f-2ed660f6ac3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:14.963352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-89112810-eb8e-4005-839f-2ed660f6ac3a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.157129 Jul 18 16:56:14.963927 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 314/629] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:14 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:15.980790 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4951b7ae-2cdf-485c-b8ce-7d8a666fa29b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:15.981357 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4951b7ae-2cdf-485c-b8ce-7d8a666fa29b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:15.987478 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4951b7ae-2cdf-485c-b8ce-7d8a666fa29b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:15.987950 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4951b7ae-2cdf-485c-b8ce-7d8a666fa29b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:15.988711 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4951b7ae-2cdf-485c-b8ce-7d8a666fa29b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:15.989148 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4951b7ae-2cdf-485c-b8ce-7d8a666fa29b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:16.127250 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4951b7ae-2cdf-485c-b8ce-7d8a666fa29b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:16.134923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4951b7ae-2cdf-485c-b8ce-7d8a666fa29b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158079 Jul 18 16:56:16.135482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 316/630] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:15 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:17.152348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-83ab3cc0-2848-4c17-a9cb-09d7ef3864fb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:17.152891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-83ab3cc0-2848-4c17-a9cb-09d7ef3864fb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:17.155133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:17.160773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83ab3cc0-2848-4c17-a9cb-09d7ef3864fb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:17.161219 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83ab3cc0-2848-4c17-a9cb-09d7ef3864fb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:17.161979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83ab3cc0-2848-4c17-a9cb-09d7ef3864fb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:17.162410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83ab3cc0-2848-4c17-a9cb-09d7ef3864fb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:17.165367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:17.297290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-83ab3cc0-2848-4c17-a9cb-09d7ef3864fb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:17.305051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-83ab3cc0-2848-4c17-a9cb-09d7ef3864fb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.156632 Jul 18 16:56:17.305607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 315/631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:17 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:18.322669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-556ed6e4-1656-4beb-8444-dcb089c117ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:18.323273 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-556ed6e4-1656-4beb-8444-dcb089c117ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:18.330049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-556ed6e4-1656-4beb-8444-dcb089c117ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:18.330493 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-556ed6e4-1656-4beb-8444-dcb089c117ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:18.331245 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-556ed6e4-1656-4beb-8444-dcb089c117ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:18.331705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-556ed6e4-1656-4beb-8444-dcb089c117ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:18.464382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-556ed6e4-1656-4beb-8444-dcb089c117ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:18.476092 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-556ed6e4-1656-4beb-8444-dcb089c117ea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.154449 Jul 18 16:56:18.476092 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 317/632] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:18 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:19.490650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2e931845-2fc0-4b51-857e-a53ec0711d7b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:19.491267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2e931845-2fc0-4b51-857e-a53ec0711d7b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:19.499573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2e931845-2fc0-4b51-857e-a53ec0711d7b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.500004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2e931845-2fc0-4b51-857e-a53ec0711d7b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.500776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2e931845-2fc0-4b51-857e-a53ec0711d7b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:19.501214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2e931845-2fc0-4b51-857e-a53ec0711d7b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:19.672348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2e931845-2fc0-4b51-857e-a53ec0711d7b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:19.681587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2e931845-2fc0-4b51-857e-a53ec0711d7b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.194428 Jul 18 16:56:19.681868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 316/633] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:19 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:20.698197 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d627de33-dd9a-44b5-be72-0c155b140d0d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:20.698803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d627de33-dd9a-44b5-be72-0c155b140d0d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:20.700740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=26 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:20.705743 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d627de33-dd9a-44b5-be72-0c155b140d0d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:20.706192 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d627de33-dd9a-44b5-be72-0c155b140d0d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:20.706948 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d627de33-dd9a-44b5-be72-0c155b140d0d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:20.707382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d627de33-dd9a-44b5-be72-0c155b140d0d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:20.710139 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=78 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:20.847206 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d627de33-dd9a-44b5-be72-0c155b140d0d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:20.854827 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d627de33-dd9a-44b5-be72-0c155b140d0d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160397 Jul 18 16:56:20.855400 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 318/634] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:20 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:21.872776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-afee019d-61a7-40d6-ba14-72964de4c5d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:21.873376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-afee019d-61a7-40d6-ba14-72964de4c5d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:21.880474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afee019d-61a7-40d6-ba14-72964de4c5d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.881001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afee019d-61a7-40d6-ba14-72964de4c5d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:21.881769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afee019d-61a7-40d6-ba14-72964de4c5d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:21.882215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-afee019d-61a7-40d6-ba14-72964de4c5d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:22.018660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-afee019d-61a7-40d6-ba14-72964de4c5d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:22.026190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-afee019d-61a7-40d6-ba14-72964de4c5d7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.157328 Jul 18 16:56:22.026742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 317/635] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:23.044400 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f84b9437-6a8b-4503-a94a-f98304058d49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:23.044996 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f84b9437-6a8b-4503-a94a-f98304058d49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:23.052061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f84b9437-6a8b-4503-a94a-f98304058d49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:23.052516 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f84b9437-6a8b-4503-a94a-f98304058d49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:23.053298 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f84b9437-6a8b-4503-a94a-f98304058d49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:23.053736 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f84b9437-6a8b-4503-a94a-f98304058d49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:23.198065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f84b9437-6a8b-4503-a94a-f98304058d49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:23.207816 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f84b9437-6a8b-4503-a94a-f98304058d49 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.167815 Jul 18 16:56:23.208399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 319/636] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:24.226128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-00176fd2-ab41-4869-8e38-40c8c71ec97a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:24.226788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-00176fd2-ab41-4869-8e38-40c8c71ec97a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:24.237401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00176fd2-ab41-4869-8e38-40c8c71ec97a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.239558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00176fd2-ab41-4869-8e38-40c8c71ec97a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.239558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00176fd2-ab41-4869-8e38-40c8c71ec97a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:24.240206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00176fd2-ab41-4869-8e38-40c8c71ec97a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:24.384493 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-00176fd2-ab41-4869-8e38-40c8c71ec97a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:24.392949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-00176fd2-ab41-4869-8e38-40c8c71ec97a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171804 Jul 18 16:56:24.393532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 318/637] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:24 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:25.411193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-fd603577-8d16-4cb4-b456-bc6263a531f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:25.411818 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-fd603577-8d16-4cb4-b456-bc6263a531f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:25.417981 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fd603577-8d16-4cb4-b456-bc6263a531f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.418423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fd603577-8d16-4cb4-b456-bc6263a531f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.419168 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fd603577-8d16-4cb4-b456-bc6263a531f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:25.419619 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fd603577-8d16-4cb4-b456-bc6263a531f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:25.559359 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-fd603577-8d16-4cb4-b456-bc6263a531f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:25.568758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-fd603577-8d16-4cb4-b456-bc6263a531f2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162509 Jul 18 16:56:25.569398 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 320/638] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:26.594585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-018c0499-f8c9-44aa-be1c-16be0a8492d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:26.595329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-018c0499-f8c9-44aa-be1c-16be0a8492d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:26.603258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-018c0499-f8c9-44aa-be1c-16be0a8492d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.603796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-018c0499-f8c9-44aa-be1c-16be0a8492d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.604561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-018c0499-f8c9-44aa-be1c-16be0a8492d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:26.605002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-018c0499-f8c9-44aa-be1c-16be0a8492d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:26.736982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-018c0499-f8c9-44aa-be1c-16be0a8492d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:26.744758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-018c0499-f8c9-44aa-be1c-16be0a8492d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.154317 Jul 18 16:56:26.745341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 319/639] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:26 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:27.762212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7a5acc99-b5a9-4197-b5e8-50332beb4655 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:27.762987 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7a5acc99-b5a9-4197-b5e8-50332beb4655 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:27.769695 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a5acc99-b5a9-4197-b5e8-50332beb4655 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.770230 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a5acc99-b5a9-4197-b5e8-50332beb4655 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.771075 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a5acc99-b5a9-4197-b5e8-50332beb4655 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:27.771611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a5acc99-b5a9-4197-b5e8-50332beb4655 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:27.926537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7a5acc99-b5a9-4197-b5e8-50332beb4655 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:27.940786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7a5acc99-b5a9-4197-b5e8-50332beb4655 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.181977 Jul 18 16:56:27.941842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 321/640] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:28.142509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-83383d4d-2d8f-457a-90db-3befd3477a6e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:28.144076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-83383d4d-2d8f-457a-90db-3befd3477a6e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:28.151397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83383d4d-2d8f-457a-90db-3befd3477a6e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.151868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83383d4d-2d8f-457a-90db-3befd3477a6e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.152648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83383d4d-2d8f-457a-90db-3befd3477a6e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.153081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83383d4d-2d8f-457a-90db-3befd3477a6e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.959759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4f5e977b-a49e-428f-b2a3-6f236bc7271b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:28.960441 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4f5e977b-a49e-428f-b2a3-6f236bc7271b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:28.966635 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4f5e977b-a49e-428f-b2a3-6f236bc7271b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.967081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4f5e977b-a49e-428f-b2a3-6f236bc7271b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:28.967890 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4f5e977b-a49e-428f-b2a3-6f236bc7271b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:28.968330 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4f5e977b-a49e-428f-b2a3-6f236bc7271b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.107401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4f5e977b-a49e-428f-b2a3-6f236bc7271b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:29.121195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4f5e977b-a49e-428f-b2a3-6f236bc7271b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.165800 Jul 18 16:56:29.136849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 322/641] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:28 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:29.272313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a31e9e9f-7a48-4b5f-8e51-2fee9dee838a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:29.273174 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a31e9e9f-7a48-4b5f-8e51-2fee9dee838a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:29.281267 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a31e9e9f-7a48-4b5f-8e51-2fee9dee838a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.284195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a31e9e9f-7a48-4b5f-8e51-2fee9dee838a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.284195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a31e9e9f-7a48-4b5f-8e51-2fee9dee838a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.284924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a31e9e9f-7a48-4b5f-8e51-2fee9dee838a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.340971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a31e9e9f-7a48-4b5f-8e51-2fee9dee838a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Going to try to terminate instance {{(pid=124945) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:56:29.748931 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a31e9e9f-7a48-4b5f-8e51-2fee9dee838a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 204 len: 0 microversion: 2.1 time: 0.481030 Jul 18 16:56:29.749656 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 323/642] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 16:56:29 2022] DELETE /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 16:56:29.758834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e368274a-1999-41e0-b812-3de58a908a58 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:29.759533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e368274a-1999-41e0-b812-3de58a908a58 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:29.765565 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e368274a-1999-41e0-b812-3de58a908a58 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.766003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e368274a-1999-41e0-b812-3de58a908a58 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.766785 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e368274a-1999-41e0-b812-3de58a908a58 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:29.767211 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e368274a-1999-41e0-b812-3de58a908a58 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:29.907577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e368274a-1999-41e0-b812-3de58a908a58 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:29.916152 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e368274a-1999-41e0-b812-3de58a908a58 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.161570 Jul 18 16:56:29.916729 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 324/643] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:29 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:30.140057 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0fa3df92-f06e-4da0-9159-b5c77f9cdcfb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:30.140677 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0fa3df92-f06e-4da0-9159-b5c77f9cdcfb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:30.147718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0fa3df92-f06e-4da0-9159-b5c77f9cdcfb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.148169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0fa3df92-f06e-4da0-9159-b5c77f9cdcfb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.148934 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0fa3df92-f06e-4da0-9159-b5c77f9cdcfb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.149372 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0fa3df92-f06e-4da0-9159-b5c77f9cdcfb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.291009 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0fa3df92-f06e-4da0-9159-b5c77f9cdcfb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:30.299122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0fa3df92-f06e-4da0-9159-b5c77f9cdcfb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163027 Jul 18 16:56:30.299741 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 325/644] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:30 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:30.934121 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7952e244-0b89-4957-b596-20fcdc485763 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:30.934720 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7952e244-0b89-4957-b596-20fcdc485763 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:30.942021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7952e244-0b89-4957-b596-20fcdc485763 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.942460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7952e244-0b89-4957-b596-20fcdc485763 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:30.943215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7952e244-0b89-4957-b596-20fcdc485763 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:30.943826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7952e244-0b89-4957-b596-20fcdc485763 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.084121 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7952e244-0b89-4957-b596-20fcdc485763 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:31.093256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7952e244-0b89-4957-b596-20fcdc485763 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.162799 Jul 18 16:56:31.093852 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 326/645] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:30 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:31.318413 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-93af56dd-8635-42e7-be61-70caf76f4c35 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:31.319095 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-93af56dd-8635-42e7-be61-70caf76f4c35 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:31.325903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-93af56dd-8635-42e7-be61-70caf76f4c35 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.326344 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-93af56dd-8635-42e7-be61-70caf76f4c35 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.327119 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-93af56dd-8635-42e7-be61-70caf76f4c35 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:31.327572 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-93af56dd-8635-42e7-be61-70caf76f4c35 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:31.465547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-93af56dd-8635-42e7-be61-70caf76f4c35 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:31.474138 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-93af56dd-8635-42e7-be61-70caf76f4c35 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161505 Jul 18 16:56:31.474720 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 327/646] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:31 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:32.113113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-191da670-a249-4b3f-ac95-aaa0f91e429e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:32.113715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-191da670-a249-4b3f-ac95-aaa0f91e429e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:32.119957 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-191da670-a249-4b3f-ac95-aaa0f91e429e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.120395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-191da670-a249-4b3f-ac95-aaa0f91e429e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.121151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-191da670-a249-4b3f-ac95-aaa0f91e429e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.121576 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-191da670-a249-4b3f-ac95-aaa0f91e429e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.262296 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-191da670-a249-4b3f-ac95-aaa0f91e429e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:32.270918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-191da670-a249-4b3f-ac95-aaa0f91e429e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.162079 Jul 18 16:56:32.271670 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 328/647] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:32 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:32.491880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dabfece6-21a3-4df7-b269-6fe167cce969 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:32.492533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dabfece6-21a3-4df7-b269-6fe167cce969 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:32.498621 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dabfece6-21a3-4df7-b269-6fe167cce969 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.499058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dabfece6-21a3-4df7-b269-6fe167cce969 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.499847 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dabfece6-21a3-4df7-b269-6fe167cce969 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:32.500293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dabfece6-21a3-4df7-b269-6fe167cce969 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:32.646690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dabfece6-21a3-4df7-b269-6fe167cce969 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:32.655272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dabfece6-21a3-4df7-b269-6fe167cce969 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.167323 Jul 18 16:56:32.658594 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 329/648] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:32 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:33.288658 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-fa030ecf-4aee-46be-bf0f-3158e267261d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:33.289256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-fa030ecf-4aee-46be-bf0f-3158e267261d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:33.295440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fa030ecf-4aee-46be-bf0f-3158e267261d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.295913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fa030ecf-4aee-46be-bf0f-3158e267261d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:33.296675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fa030ecf-4aee-46be-bf0f-3158e267261d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.297109 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fa030ecf-4aee-46be-bf0f-3158e267261d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:33.435863 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-fa030ecf-4aee-46be-bf0f-3158e267261d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:33.444012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-fa030ecf-4aee-46be-bf0f-3158e267261d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.159076 Jul 18 16:56:33.444574 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 330/649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:33 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:33.672925 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9e05a37a-196d-4624-af9a-718553d259ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:33.673564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9e05a37a-196d-4624-af9a-718553d259ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:33.679643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e05a37a-196d-4624-af9a-718553d259ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.680082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e05a37a-196d-4624-af9a-718553d259ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:33.680826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e05a37a-196d-4624-af9a-718553d259ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:33.681252 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e05a37a-196d-4624-af9a-718553d259ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:33.820232 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9e05a37a-196d-4624-af9a-718553d259ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:33.829569 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9e05a37a-196d-4624-af9a-718553d259ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160156 Jul 18 16:56:33.830248 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 331/650] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:34.461091 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ea375dff-6291-4a83-8414-9b7b21c85036 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:34.461698 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ea375dff-6291-4a83-8414-9b7b21c85036 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:34.467854 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea375dff-6291-4a83-8414-9b7b21c85036 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.468302 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea375dff-6291-4a83-8414-9b7b21c85036 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.469067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea375dff-6291-4a83-8414-9b7b21c85036 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.470019 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea375dff-6291-4a83-8414-9b7b21c85036 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.602968 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ea375dff-6291-4a83-8414-9b7b21c85036 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:34.611591 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ea375dff-6291-4a83-8414-9b7b21c85036 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.154365 Jul 18 16:56:34.612181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 332/651] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:34 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:34.847480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-feb3de72-e939-485e-a0fa-5ae386a98c34 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:34.854160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-feb3de72-e939-485e-a0fa-5ae386a98c34 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:34.854160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-feb3de72-e939-485e-a0fa-5ae386a98c34 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.854530 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-feb3de72-e939-485e-a0fa-5ae386a98c34 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.855274 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-feb3de72-e939-485e-a0fa-5ae386a98c34 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:34.855730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-feb3de72-e939-485e-a0fa-5ae386a98c34 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:34.858311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:34.995364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-feb3de72-e939-485e-a0fa-5ae386a98c34 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:35.003704 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-feb3de72-e939-485e-a0fa-5ae386a98c34 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161308 Jul 18 16:56:35.004274 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 333/652] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:34 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:35.630282 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2897aba2-0fe0-49d4-b23d-a6ff40dcbdaf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:35.630893 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2897aba2-0fe0-49d4-b23d-a6ff40dcbdaf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:35.637900 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2897aba2-0fe0-49d4-b23d-a6ff40dcbdaf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:35.638337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2897aba2-0fe0-49d4-b23d-a6ff40dcbdaf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:35.639105 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2897aba2-0fe0-49d4-b23d-a6ff40dcbdaf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:35.639562 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2897aba2-0fe0-49d4-b23d-a6ff40dcbdaf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:35.786704 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2897aba2-0fe0-49d4-b23d-a6ff40dcbdaf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:35.794819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2897aba2-0fe0-49d4-b23d-a6ff40dcbdaf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.169669 Jul 18 16:56:35.795383 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 334/653] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:35 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:36.020882 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f5297fb4-14ab-4538-8d50-90dc2243c71f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:36.021549 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f5297fb4-14ab-4538-8d50-90dc2243c71f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:36.027620 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5297fb4-14ab-4538-8d50-90dc2243c71f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.028087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5297fb4-14ab-4538-8d50-90dc2243c71f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.028873 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5297fb4-14ab-4538-8d50-90dc2243c71f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.029309 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5297fb4-14ab-4538-8d50-90dc2243c71f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.184251 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f5297fb4-14ab-4538-8d50-90dc2243c71f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:36.193053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f5297fb4-14ab-4538-8d50-90dc2243c71f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.174947 Jul 18 16:56:36.193053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 335/654] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:36 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:36.814119 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bb17a50f-9f94-407d-b7e1-527c5a13b7bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:36.814727 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bb17a50f-9f94-407d-b7e1-527c5a13b7bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:36.821589 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb17a50f-9f94-407d-b7e1-527c5a13b7bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.822043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb17a50f-9f94-407d-b7e1-527c5a13b7bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.822829 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb17a50f-9f94-407d-b7e1-527c5a13b7bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:36.823254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb17a50f-9f94-407d-b7e1-527c5a13b7bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:36.964653 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bb17a50f-9f94-407d-b7e1-527c5a13b7bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:36.972726 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bb17a50f-9f94-407d-b7e1-527c5a13b7bf tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.163272 Jul 18 16:56:36.973285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 336/655] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:36 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:37.210912 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-571a76b5-e08e-4c3a-8846-09c15faa6891 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:37.211577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-571a76b5-e08e-4c3a-8846-09c15faa6891 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:37.217617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-571a76b5-e08e-4c3a-8846-09c15faa6891 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.218064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-571a76b5-e08e-4c3a-8846-09c15faa6891 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.218824 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-571a76b5-e08e-4c3a-8846-09c15faa6891 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.219876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-571a76b5-e08e-4c3a-8846-09c15faa6891 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.360944 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-571a76b5-e08e-4c3a-8846-09c15faa6891 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:37.368694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-571a76b5-e08e-4c3a-8846-09c15faa6891 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162062 Jul 18 16:56:37.369265 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 337/656] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:37 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:37.990468 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-022c2d5c-1468-4ae8-9a0d-5f14dbd55d70 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:37.991038 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-022c2d5c-1468-4ae8-9a0d-5f14dbd55d70 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:37.997214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-022c2d5c-1468-4ae8-9a0d-5f14dbd55d70 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.997645 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-022c2d5c-1468-4ae8-9a0d-5f14dbd55d70 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:37.998428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-022c2d5c-1468-4ae8-9a0d-5f14dbd55d70 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:37.998875 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-022c2d5c-1468-4ae8-9a0d-5f14dbd55d70 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.150957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=11 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:38.151709 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-022c2d5c-1468-4ae8-9a0d-5f14dbd55d70 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:38.160532 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-022c2d5c-1468-4ae8-9a0d-5f14dbd55d70 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.173896 Jul 18 16:56:38.161108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 338/657] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:37 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:38.225309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=33 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:38.387036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f50a8cc9-727b-49fa-8662-3e94925a410d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:38.387689 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f50a8cc9-727b-49fa-8662-3e94925a410d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:38.394453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f50a8cc9-727b-49fa-8662-3e94925a410d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.394902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f50a8cc9-727b-49fa-8662-3e94925a410d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.395707 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f50a8cc9-727b-49fa-8662-3e94925a410d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:38.396267 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f50a8cc9-727b-49fa-8662-3e94925a410d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:38.526885 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f50a8cc9-727b-49fa-8662-3e94925a410d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:38.535003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f50a8cc9-727b-49fa-8662-3e94925a410d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.151794 Jul 18 16:56:38.535577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 339/658] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:38 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:39.178001 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b89850bc-dfe3-4915-9c2a-249cabf8d88f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:39.178589 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b89850bc-dfe3-4915-9c2a-249cabf8d88f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:39.184984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b89850bc-dfe3-4915-9c2a-249cabf8d88f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.185422 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b89850bc-dfe3-4915-9c2a-249cabf8d88f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.186188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b89850bc-dfe3-4915-9c2a-249cabf8d88f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.186623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b89850bc-dfe3-4915-9c2a-249cabf8d88f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.327194 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b89850bc-dfe3-4915-9c2a-249cabf8d88f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:39.335417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b89850bc-dfe3-4915-9c2a-249cabf8d88f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.161335 Jul 18 16:56:39.336042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 340/659] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:39 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:39.552962 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4b96174a-2d72-4a71-80f3-72bc1d99cedd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:39.553661 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4b96174a-2d72-4a71-80f3-72bc1d99cedd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:39.559744 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4b96174a-2d72-4a71-80f3-72bc1d99cedd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.560200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4b96174a-2d72-4a71-80f3-72bc1d99cedd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.560958 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4b96174a-2d72-4a71-80f3-72bc1d99cedd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:39.561394 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4b96174a-2d72-4a71-80f3-72bc1d99cedd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:39.700498 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4b96174a-2d72-4a71-80f3-72bc1d99cedd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:39.708366 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4b96174a-2d72-4a71-80f3-72bc1d99cedd tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160022 Jul 18 16:56:39.708937 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 341/660] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:39 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:40.353155 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2ebcbe45-6250-4399-8fe4-bf2e70b2a4ab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:40.353773 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2ebcbe45-6250-4399-8fe4-bf2e70b2a4ab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:40.360402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ebcbe45-6250-4399-8fe4-bf2e70b2a4ab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.360844 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ebcbe45-6250-4399-8fe4-bf2e70b2a4ab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.361834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ebcbe45-6250-4399-8fe4-bf2e70b2a4ab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.362435 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ebcbe45-6250-4399-8fe4-bf2e70b2a4ab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.498451 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2ebcbe45-6250-4399-8fe4-bf2e70b2a4ab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:40.506906 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2ebcbe45-6250-4399-8fe4-bf2e70b2a4ab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.157809 Jul 18 16:56:40.507460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 342/661] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:40 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:40.725975 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3f663b65-7475-4b15-b0ea-f8def1a6fadc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:40.726698 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3f663b65-7475-4b15-b0ea-f8def1a6fadc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:40.732795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f663b65-7475-4b15-b0ea-f8def1a6fadc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.733240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f663b65-7475-4b15-b0ea-f8def1a6fadc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.734018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f663b65-7475-4b15-b0ea-f8def1a6fadc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:40.735377 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f663b65-7475-4b15-b0ea-f8def1a6fadc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:40.876263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3f663b65-7475-4b15-b0ea-f8def1a6fadc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:40.884190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3f663b65-7475-4b15-b0ea-f8def1a6fadc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.162127 Jul 18 16:56:40.884762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 343/662] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:40 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:41.524644 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-593c1e94-56c9-47eb-adbf-c64cb2607a47 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:41.525242 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-593c1e94-56c9-47eb-adbf-c64cb2607a47 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:41.532544 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-593c1e94-56c9-47eb-adbf-c64cb2607a47 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.533025 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-593c1e94-56c9-47eb-adbf-c64cb2607a47 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:41.533813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-593c1e94-56c9-47eb-adbf-c64cb2607a47 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.534238 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-593c1e94-56c9-47eb-adbf-c64cb2607a47 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:41.680975 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-593c1e94-56c9-47eb-adbf-c64cb2607a47 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:41.689453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-593c1e94-56c9-47eb-adbf-c64cb2607a47 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.168581 Jul 18 16:56:41.690024 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 344/663] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:41 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:41.902339 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7d23f119-cb70-4297-834f-1955fb6ba512 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:41.903018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7d23f119-cb70-4297-834f-1955fb6ba512 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:41.909268 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d23f119-cb70-4297-834f-1955fb6ba512 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.909722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d23f119-cb70-4297-834f-1955fb6ba512 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:41.910484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d23f119-cb70-4297-834f-1955fb6ba512 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:41.910921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d23f119-cb70-4297-834f-1955fb6ba512 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.048764 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7d23f119-cb70-4297-834f-1955fb6ba512 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:42.056611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7d23f119-cb70-4297-834f-1955fb6ba512 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158242 Jul 18 16:56:42.057196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 345/664] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:41 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:42.707630 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0eb62234-d66a-4c08-80e0-78f1d7eed4fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:42.708243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0eb62234-d66a-4c08-80e0-78f1d7eed4fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:42.714523 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0eb62234-d66a-4c08-80e0-78f1d7eed4fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.714973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0eb62234-d66a-4c08-80e0-78f1d7eed4fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.715798 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0eb62234-d66a-4c08-80e0-78f1d7eed4fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:42.716242 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0eb62234-d66a-4c08-80e0-78f1d7eed4fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:42.861118 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0eb62234-d66a-4c08-80e0-78f1d7eed4fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:42.869029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0eb62234-d66a-4c08-80e0-78f1d7eed4fb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.165284 Jul 18 16:56:42.869582 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 346/665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:42 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:43.074145 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7714814b-0409-49c3-bca6-ccce5a7184a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:43.074904 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7714814b-0409-49c3-bca6-ccce5a7184a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:43.081444 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7714814b-0409-49c3-bca6-ccce5a7184a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.081892 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7714814b-0409-49c3-bca6-ccce5a7184a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.082666 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7714814b-0409-49c3-bca6-ccce5a7184a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.083106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7714814b-0409-49c3-bca6-ccce5a7184a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.222626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7714814b-0409-49c3-bca6-ccce5a7184a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:43.230816 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7714814b-0409-49c3-bca6-ccce5a7184a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160326 Jul 18 16:56:43.231687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 347/666] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:43 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:43.885709 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4998ba75-04fe-4a62-9559-f25bf8d8ad6b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:43.886308 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4998ba75-04fe-4a62-9559-f25bf8d8ad6b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:43.893731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4998ba75-04fe-4a62-9559-f25bf8d8ad6b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.894183 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4998ba75-04fe-4a62-9559-f25bf8d8ad6b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:43.895004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4998ba75-04fe-4a62-9559-f25bf8d8ad6b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:43.895759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4998ba75-04fe-4a62-9559-f25bf8d8ad6b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.034710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4998ba75-04fe-4a62-9559-f25bf8d8ad6b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:44.042693 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4998ba75-04fe-4a62-9559-f25bf8d8ad6b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.160856 Jul 18 16:56:44.043252 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 348/667] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:43 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:44.249537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dd308be3-438c-4949-9e60-8ad20d53f2ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:44.250212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dd308be3-438c-4949-9e60-8ad20d53f2ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:44.256207 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd308be3-438c-4949-9e60-8ad20d53f2ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.256659 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd308be3-438c-4949-9e60-8ad20d53f2ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.257429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd308be3-438c-4949-9e60-8ad20d53f2ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:44.257864 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd308be3-438c-4949-9e60-8ad20d53f2ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:44.391672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dd308be3-438c-4949-9e60-8ad20d53f2ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:44.393819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:44.399697 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dd308be3-438c-4949-9e60-8ad20d53f2ed tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.154084 Jul 18 16:56:44.400260 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 349/668] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:44 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:45.061139 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cefc438e-96f0-49b5-8ee3-dcc936529316 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:45.061748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cefc438e-96f0-49b5-8ee3-dcc936529316 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:45.068801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cefc438e-96f0-49b5-8ee3-dcc936529316 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:45.069239 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cefc438e-96f0-49b5-8ee3-dcc936529316 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:45.070018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cefc438e-96f0-49b5-8ee3-dcc936529316 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:45.070476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cefc438e-96f0-49b5-8ee3-dcc936529316 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:45.212812 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cefc438e-96f0-49b5-8ee3-dcc936529316 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:45.222286 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cefc438e-96f0-49b5-8ee3-dcc936529316 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.165359 Jul 18 16:56:45.222858 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 350/669] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:45 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:45.417343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-634d3cd3-3eff-469e-86d1-eec3c96599a6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:45.417977 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-634d3cd3-3eff-469e-86d1-eec3c96599a6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:45.425148 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-634d3cd3-3eff-469e-86d1-eec3c96599a6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:45.425596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-634d3cd3-3eff-469e-86d1-eec3c96599a6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:45.426352 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-634d3cd3-3eff-469e-86d1-eec3c96599a6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:45.426780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-634d3cd3-3eff-469e-86d1-eec3c96599a6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:45.561961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-634d3cd3-3eff-469e-86d1-eec3c96599a6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:45.569904 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-634d3cd3-3eff-469e-86d1-eec3c96599a6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.156466 Jul 18 16:56:45.570461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 351/670] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:45 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:46.241549 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-23a5cb5e-fb78-4aa2-a645-ae7819169d82 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:46.242683 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-23a5cb5e-fb78-4aa2-a645-ae7819169d82 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:46.256242 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23a5cb5e-fb78-4aa2-a645-ae7819169d82 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:46.256714 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23a5cb5e-fb78-4aa2-a645-ae7819169d82 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:46.257628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23a5cb5e-fb78-4aa2-a645-ae7819169d82 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:46.258076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23a5cb5e-fb78-4aa2-a645-ae7819169d82 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:46.395710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-23a5cb5e-fb78-4aa2-a645-ae7819169d82 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:46.403614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-23a5cb5e-fb78-4aa2-a645-ae7819169d82 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.166592 Jul 18 16:56:46.404177 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 352/671] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:46 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:46.587821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9a029004-16c5-4d1a-9440-6b32a8e3ecb8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:46.588454 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9a029004-16c5-4d1a-9440-6b32a8e3ecb8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:46.595124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9a029004-16c5-4d1a-9440-6b32a8e3ecb8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:46.595599 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9a029004-16c5-4d1a-9440-6b32a8e3ecb8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:46.596353 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9a029004-16c5-4d1a-9440-6b32a8e3ecb8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:46.596784 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9a029004-16c5-4d1a-9440-6b32a8e3ecb8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:46.733979 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9a029004-16c5-4d1a-9440-6b32a8e3ecb8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:46.742102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9a029004-16c5-4d1a-9440-6b32a8e3ecb8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158204 Jul 18 16:56:46.742676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 353/672] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:46 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:47.425648 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-03b8f773-f7f8-4079-ba7b-28afd09f9894 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:47.426760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-03b8f773-f7f8-4079-ba7b-28afd09f9894 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:47.437981 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03b8f773-f7f8-4079-ba7b-28afd09f9894 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.438799 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03b8f773-f7f8-4079-ba7b-28afd09f9894 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.439687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03b8f773-f7f8-4079-ba7b-28afd09f9894 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.440126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03b8f773-f7f8-4079-ba7b-28afd09f9894 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.573113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-03b8f773-f7f8-4079-ba7b-28afd09f9894 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:47.581343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-03b8f773-f7f8-4079-ba7b-28afd09f9894 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.163599 Jul 18 16:56:47.581903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 354/673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:47 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:47.759255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c75f7bad-0cdf-44e0-b734-3e0e71b356cb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:47.759960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c75f7bad-0cdf-44e0-b734-3e0e71b356cb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:47.766003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c75f7bad-0cdf-44e0-b734-3e0e71b356cb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.766716 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c75f7bad-0cdf-44e0-b734-3e0e71b356cb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.767530 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c75f7bad-0cdf-44e0-b734-3e0e71b356cb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:47.767971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c75f7bad-0cdf-44e0-b734-3e0e71b356cb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:47.911669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c75f7bad-0cdf-44e0-b734-3e0e71b356cb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:47.919400 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c75f7bad-0cdf-44e0-b734-3e0e71b356cb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163948 Jul 18 16:56:47.920000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 355/674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:47 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:48.598807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-07b127b4-3787-4909-a796-3976ff93cdd6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:48.599420 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-07b127b4-3787-4909-a796-3976ff93cdd6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:48.605871 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-07b127b4-3787-4909-a796-3976ff93cdd6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:48.606318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-07b127b4-3787-4909-a796-3976ff93cdd6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:48.607087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-07b127b4-3787-4909-a796-3976ff93cdd6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:48.607551 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-07b127b4-3787-4909-a796-3976ff93cdd6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:48.739426 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-07b127b4-3787-4909-a796-3976ff93cdd6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:48.747566 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-07b127b4-3787-4909-a796-3976ff93cdd6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.152711 Jul 18 16:56:48.748129 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 356/675] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:48 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:48.936556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3e5b1133-99af-4d11-9a4c-1e882abd7a28 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:48.937832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3e5b1133-99af-4d11-9a4c-1e882abd7a28 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:48.944224 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e5b1133-99af-4d11-9a4c-1e882abd7a28 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:48.944672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e5b1133-99af-4d11-9a4c-1e882abd7a28 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:48.945568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e5b1133-99af-4d11-9a4c-1e882abd7a28 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:48.946000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e5b1133-99af-4d11-9a4c-1e882abd7a28 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.091172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3e5b1133-99af-4d11-9a4c-1e882abd7a28 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:49.099301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3e5b1133-99af-4d11-9a4c-1e882abd7a28 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.166627 Jul 18 16:56:49.100018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 357/676] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:48 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:49.765907 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1eb8324c-1c5c-4f59-9b5d-a7b87047584d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:49.766510 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1eb8324c-1c5c-4f59-9b5d-a7b87047584d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:49.772960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1eb8324c-1c5c-4f59-9b5d-a7b87047584d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.773403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1eb8324c-1c5c-4f59-9b5d-a7b87047584d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.774175 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1eb8324c-1c5c-4f59-9b5d-a7b87047584d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:49.774611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1eb8324c-1c5c-4f59-9b5d-a7b87047584d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:49.916279 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1eb8324c-1c5c-4f59-9b5d-a7b87047584d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:49.925399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1eb8324c-1c5c-4f59-9b5d-a7b87047584d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.163684 Jul 18 16:56:49.929895 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 358/677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:49 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:50.115905 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c07c25f1-9d3e-44a4-9de8-0d51b962ace3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:50.116556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c07c25f1-9d3e-44a4-9de8-0d51b962ace3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:50.122723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c07c25f1-9d3e-44a4-9de8-0d51b962ace3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:50.123181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c07c25f1-9d3e-44a4-9de8-0d51b962ace3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:50.123958 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c07c25f1-9d3e-44a4-9de8-0d51b962ace3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:50.124387 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c07c25f1-9d3e-44a4-9de8-0d51b962ace3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:50.263953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c07c25f1-9d3e-44a4-9de8-0d51b962ace3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:50.272742 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c07c25f1-9d3e-44a4-9de8-0d51b962ace3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160570 Jul 18 16:56:50.273332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 359/678] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:50 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:50.942872 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-45f6f1c4-b4fa-4be6-8e48-242f8bebd8d2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:50.943486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-45f6f1c4-b4fa-4be6-8e48-242f8bebd8d2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:50.945589 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:50.950593 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-45f6f1c4-b4fa-4be6-8e48-242f8bebd8d2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:50.951038 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-45f6f1c4-b4fa-4be6-8e48-242f8bebd8d2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:50.951833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-45f6f1c4-b4fa-4be6-8e48-242f8bebd8d2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:50.952258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-45f6f1c4-b4fa-4be6-8e48-242f8bebd8d2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.092085 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-45f6f1c4-b4fa-4be6-8e48-242f8bebd8d2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:51.101749 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-45f6f1c4-b4fa-4be6-8e48-242f8bebd8d2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.162993 Jul 18 16:56:51.102438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 360/679] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:50 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:51.301410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cb639900-2646-4415-bf9e-3568c4d6b050 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:51.302096 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cb639900-2646-4415-bf9e-3568c4d6b050 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:51.308823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cb639900-2646-4415-bf9e-3568c4d6b050 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.309275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cb639900-2646-4415-bf9e-3568c4d6b050 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.310044 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cb639900-2646-4415-bf9e-3568c4d6b050 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:51.310476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cb639900-2646-4415-bf9e-3568c4d6b050 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:51.456709 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cb639900-2646-4415-bf9e-3568c4d6b050 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:51.464546 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cb639900-2646-4415-bf9e-3568c4d6b050 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.167917 Jul 18 16:56:51.465128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 361/680] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:51 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:52.121489 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-aa54d224-e4c0-4194-9012-5841da2c6591 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:52.122107 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-aa54d224-e4c0-4194-9012-5841da2c6591 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:52.130758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-aa54d224-e4c0-4194-9012-5841da2c6591 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:52.131202 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-aa54d224-e4c0-4194-9012-5841da2c6591 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:52.132117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-aa54d224-e4c0-4194-9012-5841da2c6591 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:52.132752 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-aa54d224-e4c0-4194-9012-5841da2c6591 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:52.284785 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-aa54d224-e4c0-4194-9012-5841da2c6591 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:52.293298 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-aa54d224-e4c0-4194-9012-5841da2c6591 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.175688 Jul 18 16:56:52.293876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 362/681] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:52 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:52.482677 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7ba56a08-f9fc-44cd-b33f-34916a4b6340 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:52.483530 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7ba56a08-f9fc-44cd-b33f-34916a4b6340 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:52.490452 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7ba56a08-f9fc-44cd-b33f-34916a4b6340 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:52.490906 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7ba56a08-f9fc-44cd-b33f-34916a4b6340 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:52.491724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7ba56a08-f9fc-44cd-b33f-34916a4b6340 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:52.492169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7ba56a08-f9fc-44cd-b33f-34916a4b6340 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:52.633523 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7ba56a08-f9fc-44cd-b33f-34916a4b6340 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:52.642388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7ba56a08-f9fc-44cd-b33f-34916a4b6340 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163627 Jul 18 16:56:52.642973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 363/682] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:52 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:53.312039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ac87ad3e-f28f-4267-a116-c3a10cdaaee1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:53.312894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ac87ad3e-f28f-4267-a116-c3a10cdaaee1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:53.319337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac87ad3e-f28f-4267-a116-c3a10cdaaee1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:53.319816 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac87ad3e-f28f-4267-a116-c3a10cdaaee1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:53.320595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac87ad3e-f28f-4267-a116-c3a10cdaaee1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:53.321034 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac87ad3e-f28f-4267-a116-c3a10cdaaee1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:53.457519 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ac87ad3e-f28f-4267-a116-c3a10cdaaee1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:53.465956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ac87ad3e-f28f-4267-a116-c3a10cdaaee1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.157855 Jul 18 16:56:53.466530 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 364/683] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:53 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:53.659199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7281aa90-c703-4d81-9b07-e8c3f424346a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:53.659879 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7281aa90-c703-4d81-9b07-e8c3f424346a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:53.666638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7281aa90-c703-4d81-9b07-e8c3f424346a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:53.667069 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7281aa90-c703-4d81-9b07-e8c3f424346a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:53.667870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7281aa90-c703-4d81-9b07-e8c3f424346a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:53.668307 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7281aa90-c703-4d81-9b07-e8c3f424346a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:53.807889 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7281aa90-c703-4d81-9b07-e8c3f424346a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:53.816110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7281aa90-c703-4d81-9b07-e8c3f424346a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.160890 Jul 18 16:56:53.816684 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 365/684] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:53 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:54.485498 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b2360ae4-c92e-4850-b53f-948f59e3624e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:54.486117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b2360ae4-c92e-4850-b53f-948f59e3624e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:54.492575 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b2360ae4-c92e-4850-b53f-948f59e3624e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:54.493021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b2360ae4-c92e-4850-b53f-948f59e3624e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:54.493790 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b2360ae4-c92e-4850-b53f-948f59e3624e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:54.494226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b2360ae4-c92e-4850-b53f-948f59e3624e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:54.511151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:54.630146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b2360ae4-c92e-4850-b53f-948f59e3624e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:54.638194 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b2360ae4-c92e-4850-b53f-948f59e3624e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.157107 Jul 18 16:56:54.638755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 366/685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:54 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:54.834588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-88abc935-0480-409b-ac0c-73e54aa2c21c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:54.835252 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-88abc935-0480-409b-ac0c-73e54aa2c21c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:54.841561 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-88abc935-0480-409b-ac0c-73e54aa2c21c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:54.841990 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-88abc935-0480-409b-ac0c-73e54aa2c21c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:54.842757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-88abc935-0480-409b-ac0c-73e54aa2c21c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:54.843180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-88abc935-0480-409b-ac0c-73e54aa2c21c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:54.980951 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-88abc935-0480-409b-ac0c-73e54aa2c21c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:54.993389 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-88abc935-0480-409b-ac0c-73e54aa2c21c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.163934 Jul 18 16:56:54.993968 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 367/686] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:54 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:55.656171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bb9defac-9c9e-44be-946b-9bdba30ed9f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:55.656775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bb9defac-9c9e-44be-946b-9bdba30ed9f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:55.664187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb9defac-9c9e-44be-946b-9bdba30ed9f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:55.664623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb9defac-9c9e-44be-946b-9bdba30ed9f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:55.665379 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb9defac-9c9e-44be-946b-9bdba30ed9f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:55.665804 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb9defac-9c9e-44be-946b-9bdba30ed9f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:55.821557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bb9defac-9c9e-44be-946b-9bdba30ed9f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:55.833988 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bb9defac-9c9e-44be-946b-9bdba30ed9f3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.181218 Jul 18 16:56:55.835526 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 368/687] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:55 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:56.011856 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6e7f87ab-4e4a-4e9c-b89e-3202a72238a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:56.012466 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6e7f87ab-4e4a-4e9c-b89e-3202a72238a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:56.019747 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e7f87ab-4e4a-4e9c-b89e-3202a72238a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:56.020198 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e7f87ab-4e4a-4e9c-b89e-3202a72238a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:56.020973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e7f87ab-4e4a-4e9c-b89e-3202a72238a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:56.021403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e7f87ab-4e4a-4e9c-b89e-3202a72238a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:56.170019 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6e7f87ab-4e4a-4e9c-b89e-3202a72238a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:56.179691 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6e7f87ab-4e4a-4e9c-b89e-3202a72238a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.171643 Jul 18 16:56:56.180286 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 369/688] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:56 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:56.855956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-56084c87-e86a-427f-9800-a2c8b7be943a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:56.856632 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-56084c87-e86a-427f-9800-a2c8b7be943a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:56.863902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-56084c87-e86a-427f-9800-a2c8b7be943a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:56.864360 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-56084c87-e86a-427f-9800-a2c8b7be943a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:56.865124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-56084c87-e86a-427f-9800-a2c8b7be943a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:56.865563 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-56084c87-e86a-427f-9800-a2c8b7be943a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:56.996400 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-56084c87-e86a-427f-9800-a2c8b7be943a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:57.004661 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-56084c87-e86a-427f-9800-a2c8b7be943a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.152562 Jul 18 16:56:57.005237 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 370/689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:56 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:57.196095 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8b88cab4-2e3c-4df2-b380-39b64a00d872 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:57.196617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8b88cab4-2e3c-4df2-b380-39b64a00d872 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:57.202626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b88cab4-2e3c-4df2-b380-39b64a00d872 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:57.203071 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b88cab4-2e3c-4df2-b380-39b64a00d872 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:57.203848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b88cab4-2e3c-4df2-b380-39b64a00d872 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:57.204808 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b88cab4-2e3c-4df2-b380-39b64a00d872 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:57.341755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8b88cab4-2e3c-4df2-b380-39b64a00d872 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:57.349911 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8b88cab4-2e3c-4df2-b380-39b64a00d872 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.157700 Jul 18 16:56:57.350474 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 371/690] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:57 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:58.023171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d18badb2-eab1-4574-b545-453d66fa445d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:58.023910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d18badb2-eab1-4574-b545-453d66fa445d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:58.030216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d18badb2-eab1-4574-b545-453d66fa445d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:58.030675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d18badb2-eab1-4574-b545-453d66fa445d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:58.031443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d18badb2-eab1-4574-b545-453d66fa445d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:58.031911 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d18badb2-eab1-4574-b545-453d66fa445d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:58.176532 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d18badb2-eab1-4574-b545-453d66fa445d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:58.184824 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d18badb2-eab1-4574-b545-453d66fa445d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.166033 Jul 18 16:56:58.185245 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 372/691] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:58 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:56:58.366880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-87456dd8-3379-4f91-8e63-87193b50f4a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:58.367482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-87456dd8-3379-4f91-8e63-87193b50f4a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:58.373648 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-87456dd8-3379-4f91-8e63-87193b50f4a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:58.374089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-87456dd8-3379-4f91-8e63-87193b50f4a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:58.374857 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-87456dd8-3379-4f91-8e63-87193b50f4a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:58.375291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-87456dd8-3379-4f91-8e63-87193b50f4a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:58.516279 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-87456dd8-3379-4f91-8e63-87193b50f4a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:58.524210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-87456dd8-3379-4f91-8e63-87193b50f4a4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.161107 Jul 18 16:56:58.524786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 373/692] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:58 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:59.202591 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1eb10dd0-cfb6-4998-8ee4-dbcf5e43dc2c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:59.203251 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1eb10dd0-cfb6-4998-8ee4-dbcf5e43dc2c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:59.210305 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1eb10dd0-cfb6-4998-8ee4-dbcf5e43dc2c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:59.210755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1eb10dd0-cfb6-4998-8ee4-dbcf5e43dc2c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:59.211568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1eb10dd0-cfb6-4998-8ee4-dbcf5e43dc2c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:59.212007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1eb10dd0-cfb6-4998-8ee4-dbcf5e43dc2c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:59.343766 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1eb10dd0-cfb6-4998-8ee4-dbcf5e43dc2c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:59.351694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1eb10dd0-cfb6-4998-8ee4-dbcf5e43dc2c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.153034 Jul 18 16:56:59.352342 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 374/693] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:59 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:56:59.541661 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-94067bd6-3588-42c5-88f6-8d2bd1b5371e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:56:59.542268 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-94067bd6-3588-42c5-88f6-8d2bd1b5371e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:56:59.549148 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-94067bd6-3588-42c5-88f6-8d2bd1b5371e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:59.549583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-94067bd6-3588-42c5-88f6-8d2bd1b5371e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:59.550377 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-94067bd6-3588-42c5-88f6-8d2bd1b5371e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:56:59.550825 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-94067bd6-3588-42c5-88f6-8d2bd1b5371e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:56:59.687676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-94067bd6-3588-42c5-88f6-8d2bd1b5371e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:56:59.696067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-94067bd6-3588-42c5-88f6-8d2bd1b5371e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158266 Jul 18 16:56:59.696633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 375/694] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:56:59 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:00.369726 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-99b2201c-b8d7-4a4a-9e92-68f67469c8d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:00.370402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-99b2201c-b8d7-4a4a-9e92-68f67469c8d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:00.376730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99b2201c-b8d7-4a4a-9e92-68f67469c8d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:00.377166 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99b2201c-b8d7-4a4a-9e92-68f67469c8d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:00.378053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99b2201c-b8d7-4a4a-9e92-68f67469c8d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:00.378682 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99b2201c-b8d7-4a4a-9e92-68f67469c8d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:00.510711 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-99b2201c-b8d7-4a4a-9e92-68f67469c8d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:00.519326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-99b2201c-b8d7-4a4a-9e92-68f67469c8d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.153340 Jul 18 16:57:00.519858 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 376/695] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:00 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:00.712275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c29d3dba-4807-403d-bd41-3e8dd465d481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:00.712883 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c29d3dba-4807-403d-bd41-3e8dd465d481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:00.718873 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c29d3dba-4807-403d-bd41-3e8dd465d481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:00.719313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c29d3dba-4807-403d-bd41-3e8dd465d481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:00.720326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c29d3dba-4807-403d-bd41-3e8dd465d481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:00.720762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c29d3dba-4807-403d-bd41-3e8dd465d481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:00.858254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c29d3dba-4807-403d-bd41-3e8dd465d481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:00.866496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c29d3dba-4807-403d-bd41-3e8dd465d481 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.158050 Jul 18 16:57:00.867058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 377/696] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:00 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:01.537167 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f5ce7a7b-e587-4d23-82a5-ba942ae88b6f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:01.537858 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f5ce7a7b-e587-4d23-82a5-ba942ae88b6f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:01.543910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5ce7a7b-e587-4d23-82a5-ba942ae88b6f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:01.544365 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5ce7a7b-e587-4d23-82a5-ba942ae88b6f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:01.545130 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5ce7a7b-e587-4d23-82a5-ba942ae88b6f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:01.545564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5ce7a7b-e587-4d23-82a5-ba942ae88b6f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:01.679802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f5ce7a7b-e587-4d23-82a5-ba942ae88b6f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:01.687178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f5ce7a7b-e587-4d23-82a5-ba942ae88b6f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.153825 Jul 18 16:57:01.687781 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 378/697] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:01 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:01.884264 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a85464fa-da0d-4b00-9fad-5c2b44d5c29e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:01.884883 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a85464fa-da0d-4b00-9fad-5c2b44d5c29e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:01.890951 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a85464fa-da0d-4b00-9fad-5c2b44d5c29e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:01.891583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a85464fa-da0d-4b00-9fad-5c2b44d5c29e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:01.892435 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a85464fa-da0d-4b00-9fad-5c2b44d5c29e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:01.892859 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a85464fa-da0d-4b00-9fad-5c2b44d5c29e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:02.025323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a85464fa-da0d-4b00-9fad-5c2b44d5c29e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:02.033350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a85464fa-da0d-4b00-9fad-5c2b44d5c29e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.153009 Jul 18 16:57:02.033910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 379/698] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:01 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:02.705718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-caf09e2e-d5f2-4baf-9308-ab591c240d25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:02.706399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-caf09e2e-d5f2-4baf-9308-ab591c240d25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:02.713026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-caf09e2e-d5f2-4baf-9308-ab591c240d25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:02.713482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-caf09e2e-d5f2-4baf-9308-ab591c240d25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:02.714302 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-caf09e2e-d5f2-4baf-9308-ab591c240d25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:02.714747 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-caf09e2e-d5f2-4baf-9308-ab591c240d25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:02.844865 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-caf09e2e-d5f2-4baf-9308-ab591c240d25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:02.852922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-caf09e2e-d5f2-4baf-9308-ab591c240d25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.151598 Jul 18 16:57:02.853485 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 380/699] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:02 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:03.050842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-50457727-a2ae-48c2-abb3-01108bcd2cba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:03.051441 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-50457727-a2ae-48c2-abb3-01108bcd2cba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:03.057506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-50457727-a2ae-48c2-abb3-01108bcd2cba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:03.057954 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-50457727-a2ae-48c2-abb3-01108bcd2cba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:03.058709 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-50457727-a2ae-48c2-abb3-01108bcd2cba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:03.059140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-50457727-a2ae-48c2-abb3-01108bcd2cba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:03.196360 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-50457727-a2ae-48c2-abb3-01108bcd2cba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:03.203997 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-50457727-a2ae-48c2-abb3-01108bcd2cba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.157399 Jul 18 16:57:03.204663 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 381/700] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:03 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:03.870684 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a80d2dd9-fbf7-4188-93d8-fca6bd414183 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:03.871644 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a80d2dd9-fbf7-4188-93d8-fca6bd414183 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:03.878386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a80d2dd9-fbf7-4188-93d8-fca6bd414183 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:03.878829 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a80d2dd9-fbf7-4188-93d8-fca6bd414183 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:03.879638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a80d2dd9-fbf7-4188-93d8-fca6bd414183 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:03.880117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a80d2dd9-fbf7-4188-93d8-fca6bd414183 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:04.011401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a80d2dd9-fbf7-4188-93d8-fca6bd414183 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:04.019483 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a80d2dd9-fbf7-4188-93d8-fca6bd414183 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.152959 Jul 18 16:57:04.020084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 382/701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:03 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:04.221481 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a0168cd7-79e2-4f03-800f-b9ab16387eef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:04.222031 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a0168cd7-79e2-4f03-800f-b9ab16387eef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:04.228110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0168cd7-79e2-4f03-800f-b9ab16387eef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:04.231606 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0168cd7-79e2-4f03-800f-b9ab16387eef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:04.231606 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0168cd7-79e2-4f03-800f-b9ab16387eef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:04.231606 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a0168cd7-79e2-4f03-800f-b9ab16387eef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:04.232373 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:04.365899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a0168cd7-79e2-4f03-800f-b9ab16387eef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:04.373388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a0168cd7-79e2-4f03-800f-b9ab16387eef tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.156475 Jul 18 16:57:04.373956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 383/702] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:04 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:05.036978 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2c810d75-0f50-4f4a-bcb7-2c86aa8284a3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:05.037628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2c810d75-0f50-4f4a-bcb7-2c86aa8284a3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:05.043875 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2c810d75-0f50-4f4a-bcb7-2c86aa8284a3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:05.044323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2c810d75-0f50-4f4a-bcb7-2c86aa8284a3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:05.045095 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2c810d75-0f50-4f4a-bcb7-2c86aa8284a3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:05.045537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2c810d75-0f50-4f4a-bcb7-2c86aa8284a3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:05.181767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2c810d75-0f50-4f4a-bcb7-2c86aa8284a3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:05.190766 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2c810d75-0f50-4f4a-bcb7-2c86aa8284a3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.157606 Jul 18 16:57:05.191338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 384/703] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:05 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:05.390670 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b95dbafd-be70-4688-8447-7272c24fc234 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:05.391240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b95dbafd-be70-4688-8447-7272c24fc234 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:05.397221 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b95dbafd-be70-4688-8447-7272c24fc234 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:05.397666 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b95dbafd-be70-4688-8447-7272c24fc234 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:05.398411 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b95dbafd-be70-4688-8447-7272c24fc234 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:05.398838 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b95dbafd-be70-4688-8447-7272c24fc234 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:05.532486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b95dbafd-be70-4688-8447-7272c24fc234 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:05.540617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b95dbafd-be70-4688-8447-7272c24fc234 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.153803 Jul 18 16:57:05.541175 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 385/704] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:05 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:05.826806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:57:05.827608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 16:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 (ip 10.222.0.26) !!! Jul 18 16:57:06.208281 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b4bc825f-64dd-4049-acfb-93c8df10975a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:06.208866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b4bc825f-64dd-4049-acfb-93c8df10975a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:06.215137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b4bc825f-64dd-4049-acfb-93c8df10975a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:06.215630 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b4bc825f-64dd-4049-acfb-93c8df10975a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:06.216376 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b4bc825f-64dd-4049-acfb-93c8df10975a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:06.216803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b4bc825f-64dd-4049-acfb-93c8df10975a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:06.355168 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b4bc825f-64dd-4049-acfb-93c8df10975a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:06.364155 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b4bc825f-64dd-4049-acfb-93c8df10975a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.159792 Jul 18 16:57:06.364710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 386/705] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:06 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:06.766300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-73c8ce80-bdac-4bf0-8e34-3288be4d6fa1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:06.767067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-73c8ce80-bdac-4bf0-8e34-3288be4d6fa1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:06.773176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c8ce80-bdac-4bf0-8e34-3288be4d6fa1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:06.773613 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c8ce80-bdac-4bf0-8e34-3288be4d6fa1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:06.774356 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c8ce80-bdac-4bf0-8e34-3288be4d6fa1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:06.774784 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c8ce80-bdac-4bf0-8e34-3288be4d6fa1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:06.906053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-73c8ce80-bdac-4bf0-8e34-3288be4d6fa1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:06.914276 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-73c8ce80-bdac-4bf0-8e34-3288be4d6fa1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.359688 Jul 18 16:57:06.914875 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 387/706] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:06 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:07.381918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9ca5374e-b065-4fce-b33b-423597e47d9e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:07.382568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9ca5374e-b065-4fce-b33b-423597e47d9e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:07.388619 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9ca5374e-b065-4fce-b33b-423597e47d9e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:07.389074 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9ca5374e-b065-4fce-b33b-423597e47d9e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:07.389842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9ca5374e-b065-4fce-b33b-423597e47d9e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:07.390285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9ca5374e-b065-4fce-b33b-423597e47d9e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:07.526407 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9ca5374e-b065-4fce-b33b-423597e47d9e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:07.535937 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9ca5374e-b065-4fce-b33b-423597e47d9e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.157743 Jul 18 16:57:07.536522 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 388/707] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:07 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:07.932426 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5582b5d7-5be9-4ad4-bc89-06c8c6aaccf5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:07.933014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5582b5d7-5be9-4ad4-bc89-06c8c6aaccf5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:07.939080 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5582b5d7-5be9-4ad4-bc89-06c8c6aaccf5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:07.939549 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5582b5d7-5be9-4ad4-bc89-06c8c6aaccf5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:07.940315 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5582b5d7-5be9-4ad4-bc89-06c8c6aaccf5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:07.940748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5582b5d7-5be9-4ad4-bc89-06c8c6aaccf5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:08.075148 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5582b5d7-5be9-4ad4-bc89-06c8c6aaccf5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:08.083232 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5582b5d7-5be9-4ad4-bc89-06c8c6aaccf5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.154726 Jul 18 16:57:08.083834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 389/708] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:08.554482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-efe69daf-d38b-4e3c-a939-f80f9a45da83 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:08.555108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-efe69daf-d38b-4e3c-a939-f80f9a45da83 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:08.561290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efe69daf-d38b-4e3c-a939-f80f9a45da83 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:08.561728 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efe69daf-d38b-4e3c-a939-f80f9a45da83 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:08.562481 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efe69daf-d38b-4e3c-a939-f80f9a45da83 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:08.563568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efe69daf-d38b-4e3c-a939-f80f9a45da83 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:08.786437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-efe69daf-d38b-4e3c-a939-f80f9a45da83 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:08.794738 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-efe69daf-d38b-4e3c-a939-f80f9a45da83 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.244260 Jul 18 16:57:08.795307 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 390/709] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:08 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:09.382469 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-251b5cee-a640-44a4-a418-3cc5b8090f72 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:09.382963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-251b5cee-a640-44a4-a418-3cc5b8090f72 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:09.389257 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-251b5cee-a640-44a4-a418-3cc5b8090f72 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.389701 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-251b5cee-a640-44a4-a418-3cc5b8090f72 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.390501 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-251b5cee-a640-44a4-a418-3cc5b8090f72 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.391463 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-251b5cee-a640-44a4-a418-3cc5b8090f72 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.417987 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-251b5cee-a640-44a4-a418-3cc5b8090f72 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Going to try to terminate instance {{(pid=124945) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 16:57:09.774080 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-251b5cee-a640-44a4-a418-3cc5b8090f72 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 204 len: 0 microversion: 2.1 time: 0.395106 Jul 18 16:57:09.774988 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 391/710] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 16:57:09 2022] DELETE /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 16:57:09.849561 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-4fc1995a-d202-4673-b430-1cc73baba81a req-3381bcc6-8789-46be-8e71-c9033c724b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1c9245-f7e5-4ff8-b561-7dc29e139931", "tag": "58e840d1-84ce-4ac8-bb93-2ee5a430d89d"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 16:57:09.857877 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-4fc1995a-d202-4673-b430-1cc73baba81a req-3381bcc6-8789-46be-8e71-c9033c724b33 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.858324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-4fc1995a-d202-4673-b430-1cc73baba81a req-3381bcc6-8789-46be-8e71-c9033c724b33 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.871040 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-4fc1995a-d202-4673-b430-1cc73baba81a req-3381bcc6-8789-46be-8e71-c9033c724b33 service nova] Creating event network-changed:58e840d1-84ce-4ac8-bb93-2ee5a430d89d for instance 6f1c9245-f7e5-4ff8-b561-7dc29e139931 on hv-cinder-84617 Jul 18 16:57:09.877780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-4fc1995a-d202-4673-b430-1cc73baba81a req-3381bcc6-8789-46be-8e71-c9033c724b33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101388 Jul 18 16:57:09.878382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 392/711] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 16:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:09.883517 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a135429b-da78-49ad-81fc-af32fe5ed7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:09.884205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a135429b-da78-49ad-81fc-af32fe5ed7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:09.892365 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a135429b-da78-49ad-81fc-af32fe5ed7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.893002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a135429b-da78-49ad-81fc-af32fe5ed7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:09.893630 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a135429b-da78-49ad-81fc-af32fe5ed7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:09.894064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a135429b-da78-49ad-81fc-af32fe5ed7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:10.052203 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a135429b-da78-49ad-81fc-af32fe5ed7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:10.060565 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a135429b-da78-49ad-81fc-af32fe5ed7bc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1566 microversion: 2.1 time: 0.181024 Jul 18 16:57:10.061149 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 393/712] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:09 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:10.068349 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7a8af93e-3235-4dae-a97f-78725b14679a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:10.068349 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7a8af93e-3235-4dae-a97f-78725b14679a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:10.076088 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a8af93e-3235-4dae-a97f-78725b14679a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:10.076544 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a8af93e-3235-4dae-a97f-78725b14679a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:10.077322 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a8af93e-3235-4dae-a97f-78725b14679a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:10.077763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a8af93e-3235-4dae-a97f-78725b14679a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:10.229774 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7a8af93e-3235-4dae-a97f-78725b14679a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:10.238491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7a8af93e-3235-4dae-a97f-78725b14679a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.176302 Jul 18 16:57:10.239262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 394/713] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:10 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:11.079320 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-71f280eb-1c46-4a8d-abe5-b80ccec9c1af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:11.080057 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-71f280eb-1c46-4a8d-abe5-b80ccec9c1af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:11.086156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-71f280eb-1c46-4a8d-abe5-b80ccec9c1af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:11.086602 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-71f280eb-1c46-4a8d-abe5-b80ccec9c1af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:11.087412 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-71f280eb-1c46-4a8d-abe5-b80ccec9c1af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:11.087821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-71f280eb-1c46-4a8d-abe5-b80ccec9c1af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:11.218029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-71f280eb-1c46-4a8d-abe5-b80ccec9c1af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:11.226239 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-71f280eb-1c46-4a8d-abe5-b80ccec9c1af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.151128 Jul 18 16:57:11.226800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 395/714] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:11 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:11.255483 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-031de743-f9c9-41f1-8e48-31039fc1926b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:11.256116 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-031de743-f9c9-41f1-8e48-31039fc1926b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:11.262117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-031de743-f9c9-41f1-8e48-31039fc1926b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:11.262558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-031de743-f9c9-41f1-8e48-31039fc1926b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:11.263308 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-031de743-f9c9-41f1-8e48-31039fc1926b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:11.263775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-031de743-f9c9-41f1-8e48-31039fc1926b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:11.391484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-031de743-f9c9-41f1-8e48-31039fc1926b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:11.399355 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-031de743-f9c9-41f1-8e48-31039fc1926b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.147613 Jul 18 16:57:11.399939 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 396/715] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:11 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:12.244269 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dacf456a-507b-4c1b-9763-520149f94c19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:12.245035 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dacf456a-507b-4c1b-9763-520149f94c19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:12.251724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dacf456a-507b-4c1b-9763-520149f94c19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:12.252168 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dacf456a-507b-4c1b-9763-520149f94c19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:12.252922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dacf456a-507b-4c1b-9763-520149f94c19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:12.253351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dacf456a-507b-4c1b-9763-520149f94c19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:12.392882 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dacf456a-507b-4c1b-9763-520149f94c19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:12.400345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dacf456a-507b-4c1b-9763-520149f94c19 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.160019 Jul 18 16:57:12.400909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 397/716] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:12 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:12.416665 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5abb8a1c-c49a-42b7-8f90-7d61f68d4ecc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:12.417259 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5abb8a1c-c49a-42b7-8f90-7d61f68d4ecc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:12.424051 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5abb8a1c-c49a-42b7-8f90-7d61f68d4ecc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:12.424490 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5abb8a1c-c49a-42b7-8f90-7d61f68d4ecc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:12.425231 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5abb8a1c-c49a-42b7-8f90-7d61f68d4ecc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:12.425694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5abb8a1c-c49a-42b7-8f90-7d61f68d4ecc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:12.553848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5abb8a1c-c49a-42b7-8f90-7d61f68d4ecc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:12.566110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:12.566110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5abb8a1c-c49a-42b7-8f90-7d61f68d4ecc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.149453 Jul 18 16:57:12.566110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 398/717] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:12 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:13.418079 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ee02a494-a8ee-4655-b62b-34650fda4c2e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:13.418758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ee02a494-a8ee-4655-b62b-34650fda4c2e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:13.426487 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ee02a494-a8ee-4655-b62b-34650fda4c2e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:13.426932 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ee02a494-a8ee-4655-b62b-34650fda4c2e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:13.427716 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ee02a494-a8ee-4655-b62b-34650fda4c2e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:13.428152 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ee02a494-a8ee-4655-b62b-34650fda4c2e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:13.563675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ee02a494-a8ee-4655-b62b-34650fda4c2e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:13.571150 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ee02a494-a8ee-4655-b62b-34650fda4c2e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.156938 Jul 18 16:57:13.571740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 399/718] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:13 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:13.580894 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ae0f53c8-f41c-46a1-bd70-a4d500143afc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:13.581505 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ae0f53c8-f41c-46a1-bd70-a4d500143afc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:13.589022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ae0f53c8-f41c-46a1-bd70-a4d500143afc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:13.589022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ae0f53c8-f41c-46a1-bd70-a4d500143afc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:13.589782 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ae0f53c8-f41c-46a1-bd70-a4d500143afc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:13.590255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ae0f53c8-f41c-46a1-bd70-a4d500143afc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:13.721275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ae0f53c8-f41c-46a1-bd70-a4d500143afc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:13.729133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ae0f53c8-f41c-46a1-bd70-a4d500143afc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.152571 Jul 18 16:57:13.729685 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 400/719] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:13 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:14.588724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e95acc15-6178-41af-8fa2-59a2b1567510 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:14.589527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e95acc15-6178-41af-8fa2-59a2b1567510 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:14.595976 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e95acc15-6178-41af-8fa2-59a2b1567510 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.596427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e95acc15-6178-41af-8fa2-59a2b1567510 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.597193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e95acc15-6178-41af-8fa2-59a2b1567510 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.597631 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e95acc15-6178-41af-8fa2-59a2b1567510 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.739719 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e95acc15-6178-41af-8fa2-59a2b1567510 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:14.747344 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e95acc15-6178-41af-8fa2-59a2b1567510 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.162418 Jul 18 16:57:14.747972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 401/720] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:14 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:14.752428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ea171009-73d9-42a5-9d10-7ddd7f4e45c0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:14.753026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ea171009-73d9-42a5-9d10-7ddd7f4e45c0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:14.759134 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea171009-73d9-42a5-9d10-7ddd7f4e45c0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.759599 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea171009-73d9-42a5-9d10-7ddd7f4e45c0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.760358 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea171009-73d9-42a5-9d10-7ddd7f4e45c0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:14.760815 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea171009-73d9-42a5-9d10-7ddd7f4e45c0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:14.898336 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ea171009-73d9-42a5-9d10-7ddd7f4e45c0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:14.907003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ea171009-73d9-42a5-9d10-7ddd7f4e45c0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.157401 Jul 18 16:57:14.907603 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 402/721] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:14 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:15.765420 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-823a3ec3-c177-4a9e-a84a-ee91bc938af8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:15.766829 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-823a3ec3-c177-4a9e-a84a-ee91bc938af8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:15.772265 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-823a3ec3-c177-4a9e-a84a-ee91bc938af8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:15.772714 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-823a3ec3-c177-4a9e-a84a-ee91bc938af8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:15.773484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-823a3ec3-c177-4a9e-a84a-ee91bc938af8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:15.773921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-823a3ec3-c177-4a9e-a84a-ee91bc938af8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:15.924348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-823a3ec3-c177-4a9e-a84a-ee91bc938af8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:15.932151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-823a3ec3-c177-4a9e-a84a-ee91bc938af8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.170574 Jul 18 16:57:15.932722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 403/722] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:15 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:15.937182 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-539b38e3-2140-48a0-b2ec-0be0cc192b87 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:15.938110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-539b38e3-2140-48a0-b2ec-0be0cc192b87 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:15.944324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-539b38e3-2140-48a0-b2ec-0be0cc192b87 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:15.944767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-539b38e3-2140-48a0-b2ec-0be0cc192b87 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:15.945531 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-539b38e3-2140-48a0-b2ec-0be0cc192b87 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:15.945964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-539b38e3-2140-48a0-b2ec-0be0cc192b87 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:16.092551 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-539b38e3-2140-48a0-b2ec-0be0cc192b87 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:16.102082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-539b38e3-2140-48a0-b2ec-0be0cc192b87 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.168337 Jul 18 16:57:16.102664 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 404/723] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:15 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:16.949700 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5a096c99-dcec-42c8-b614-5798792a15f0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:16.950374 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5a096c99-dcec-42c8-b614-5798792a15f0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:16.957098 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a096c99-dcec-42c8-b614-5798792a15f0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:16.957534 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a096c99-dcec-42c8-b614-5798792a15f0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:16.958278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a096c99-dcec-42c8-b614-5798792a15f0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:16.958703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a096c99-dcec-42c8-b614-5798792a15f0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.089666 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5a096c99-dcec-42c8-b614-5798792a15f0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:17.097233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5a096c99-dcec-42c8-b614-5798792a15f0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.151336 Jul 18 16:57:17.097795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 405/724] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:16 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:17.120874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-05f1ea76-3434-44cd-99a3-140fba07dc5b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:17.121471 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-05f1ea76-3434-44cd-99a3-140fba07dc5b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:17.127912 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-05f1ea76-3434-44cd-99a3-140fba07dc5b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:17.128356 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-05f1ea76-3434-44cd-99a3-140fba07dc5b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.129102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-05f1ea76-3434-44cd-99a3-140fba07dc5b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:17.129533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-05f1ea76-3434-44cd-99a3-140fba07dc5b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:17.264214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-05f1ea76-3434-44cd-99a3-140fba07dc5b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:17.272975 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-05f1ea76-3434-44cd-99a3-140fba07dc5b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.155705 Jul 18 16:57:17.273520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 406/725] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:17 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:18.114712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec6f579e-c507-49fd-bfb9-f00a2ce41d16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:18.115397 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ec6f579e-c507-49fd-bfb9-f00a2ce41d16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:18.118281 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:18.124069 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec6f579e-c507-49fd-bfb9-f00a2ce41d16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:18.124539 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec6f579e-c507-49fd-bfb9-f00a2ce41d16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:18.125959 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec6f579e-c507-49fd-bfb9-f00a2ce41d16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:18.126557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec6f579e-c507-49fd-bfb9-f00a2ce41d16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:18.263108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ec6f579e-c507-49fd-bfb9-f00a2ce41d16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:18.270980 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ec6f579e-c507-49fd-bfb9-f00a2ce41d16 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.160034 Jul 18 16:57:18.271574 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 407/726] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:18 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:18.290006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e26d1458-a03e-40e1-bb3d-cda1dd8159de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:18.290602 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e26d1458-a03e-40e1-bb3d-cda1dd8159de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:18.297888 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e26d1458-a03e-40e1-bb3d-cda1dd8159de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:18.298360 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e26d1458-a03e-40e1-bb3d-cda1dd8159de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:18.299108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e26d1458-a03e-40e1-bb3d-cda1dd8159de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:18.299587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e26d1458-a03e-40e1-bb3d-cda1dd8159de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:18.431167 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e26d1458-a03e-40e1-bb3d-cda1dd8159de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:18.439865 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e26d1458-a03e-40e1-bb3d-cda1dd8159de tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.153642 Jul 18 16:57:18.440517 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 408/727] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:18 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:19.287734 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-19a99581-fa0e-4d3c-b555-56add38e69e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:19.288401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-19a99581-fa0e-4d3c-b555-56add38e69e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:19.294420 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-19a99581-fa0e-4d3c-b555-56add38e69e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:19.294861 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-19a99581-fa0e-4d3c-b555-56add38e69e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:19.295625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-19a99581-fa0e-4d3c-b555-56add38e69e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:19.296056 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-19a99581-fa0e-4d3c-b555-56add38e69e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:19.431134 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-19a99581-fa0e-4d3c-b555-56add38e69e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:19.438214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-19a99581-fa0e-4d3c-b555-56add38e69e1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.154337 Jul 18 16:57:19.438778 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 409/728] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:19 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:19.457740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-666620cc-3e61-4c1f-aa35-6f86c297298e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:19.458372 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-666620cc-3e61-4c1f-aa35-6f86c297298e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:19.464277 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-666620cc-3e61-4c1f-aa35-6f86c297298e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:19.464716 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-666620cc-3e61-4c1f-aa35-6f86c297298e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:19.465484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-666620cc-3e61-4c1f-aa35-6f86c297298e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:19.465908 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-666620cc-3e61-4c1f-aa35-6f86c297298e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:19.594583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-666620cc-3e61-4c1f-aa35-6f86c297298e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:19.602496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-666620cc-3e61-4c1f-aa35-6f86c297298e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.148524 Jul 18 16:57:19.603057 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 410/729] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:19 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:20.457384 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-054a7f9a-0c56-4cbf-95f6-5e1fe6d5a98f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:20.458053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-054a7f9a-0c56-4cbf-95f6-5e1fe6d5a98f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:20.464256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-054a7f9a-0c56-4cbf-95f6-5e1fe6d5a98f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:20.464702 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-054a7f9a-0c56-4cbf-95f6-5e1fe6d5a98f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:20.465520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-054a7f9a-0c56-4cbf-95f6-5e1fe6d5a98f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:20.465954 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-054a7f9a-0c56-4cbf-95f6-5e1fe6d5a98f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:20.614362 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-054a7f9a-0c56-4cbf-95f6-5e1fe6d5a98f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:20.622116 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-054a7f9a-0c56-4cbf-95f6-5e1fe6d5a98f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.170280 Jul 18 16:57:20.622685 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 411/730] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:20 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:20.627128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f5cc35b5-e9f7-4eb9-b6ec-11e0ff89417e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:20.627749 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f5cc35b5-e9f7-4eb9-b6ec-11e0ff89417e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:20.634074 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5cc35b5-e9f7-4eb9-b6ec-11e0ff89417e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:20.634524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5cc35b5-e9f7-4eb9-b6ec-11e0ff89417e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:20.635293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5cc35b5-e9f7-4eb9-b6ec-11e0ff89417e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:20.635757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f5cc35b5-e9f7-4eb9-b6ec-11e0ff89417e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:20.782931 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f5cc35b5-e9f7-4eb9-b6ec-11e0ff89417e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:20.789759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f5cc35b5-e9f7-4eb9-b6ec-11e0ff89417e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.166066 Jul 18 16:57:20.790552 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 412/731] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:20 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:20.940385 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-752862e6-da77-435c-a485-fbd2b11c23af tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:20.941421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-752862e6-da77-435c-a485-fbd2b11c23af tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:20.947662 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-752862e6-da77-435c-a485-fbd2b11c23af tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:20.948109 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-752862e6-da77-435c-a485-fbd2b11c23af tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:20.948876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-752862e6-da77-435c-a485-fbd2b11c23af tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:20.949311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-752862e6-da77-435c-a485-fbd2b11c23af tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:20.986987 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-752862e6-da77-435c-a485-fbd2b11c23af tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051562 Jul 18 16:57:20.987981 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 413/732] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:57:20 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:57:21.034390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-83383d4d-2d8f-457a-90db-3befd3477a6e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lazy-loading 'services' on Instance uuid 295d078f-10f9-4a6d-a3c4-9636ef01a6f7 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:57:21.639791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f94b3428-95e0-42a1-9b9a-ca3238ea9517 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:21.640465 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f94b3428-95e0-42a1-9b9a-ca3238ea9517 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:21.646724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f94b3428-95e0-42a1-9b9a-ca3238ea9517 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:21.647163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f94b3428-95e0-42a1-9b9a-ca3238ea9517 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:21.647953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f94b3428-95e0-42a1-9b9a-ca3238ea9517 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:21.648380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f94b3428-95e0-42a1-9b9a-ca3238ea9517 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:21.786957 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f94b3428-95e0-42a1-9b9a-ca3238ea9517 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:21.794755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f94b3428-95e0-42a1-9b9a-ca3238ea9517 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.158807 Jul 18 16:57:21.795321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 414/733] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:21.807174 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ad37da46-37fa-48a5-b2db-860b80fcc7c3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:21.807800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ad37da46-37fa-48a5-b2db-860b80fcc7c3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:21.813896 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad37da46-37fa-48a5-b2db-860b80fcc7c3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:21.817805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad37da46-37fa-48a5-b2db-860b80fcc7c3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:21.817805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad37da46-37fa-48a5-b2db-860b80fcc7c3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:21.817805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad37da46-37fa-48a5-b2db-860b80fcc7c3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:21.831680 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:21.951365 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ad37da46-37fa-48a5-b2db-860b80fcc7c3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:21.960178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ad37da46-37fa-48a5-b2db-860b80fcc7c3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.156786 Jul 18 16:57:21.960746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 415/734] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:21 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:21.998604 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c5829b74-715a-4fe4-b947-d4ca30fd3a20 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:21.999588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c5829b74-715a-4fe4-b947-d4ca30fd3a20 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:22.006073 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c5829b74-715a-4fe4-b947-d4ca30fd3a20 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:22.006491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c5829b74-715a-4fe4-b947-d4ca30fd3a20 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:22.007267 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c5829b74-715a-4fe4-b947-d4ca30fd3a20 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:22.007767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c5829b74-715a-4fe4-b947-d4ca30fd3a20 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:22.037927 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c5829b74-715a-4fe4-b947-d4ca30fd3a20 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Jul 18 16:57:22.038481 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 416/735] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:57:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 16:57:22.813730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c36f31ed-f0a3-4a84-8483-a452a0b7d5a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:22.814476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c36f31ed-f0a3-4a84-8483-a452a0b7d5a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:22.820650 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c36f31ed-f0a3-4a84-8483-a452a0b7d5a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:22.821121 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c36f31ed-f0a3-4a84-8483-a452a0b7d5a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:22.821878 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c36f31ed-f0a3-4a84-8483-a452a0b7d5a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:22.822310 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c36f31ed-f0a3-4a84-8483-a452a0b7d5a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:22.954930 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c36f31ed-f0a3-4a84-8483-a452a0b7d5a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:22.962609 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c36f31ed-f0a3-4a84-8483-a452a0b7d5a3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.153501 Jul 18 16:57:22.963171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 417/736] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:22.977641 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-301ef3fc-6ae7-4d62-91d4-a2d83f9c37fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:22.978240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-301ef3fc-6ae7-4d62-91d4-a2d83f9c37fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:22.985131 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-301ef3fc-6ae7-4d62-91d4-a2d83f9c37fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:22.985588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-301ef3fc-6ae7-4d62-91d4-a2d83f9c37fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:22.986340 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-301ef3fc-6ae7-4d62-91d4-a2d83f9c37fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:22.986775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-301ef3fc-6ae7-4d62-91d4-a2d83f9c37fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:23.120443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-301ef3fc-6ae7-4d62-91d4-a2d83f9c37fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:23.128577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-301ef3fc-6ae7-4d62-91d4-a2d83f9c37fe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.154599 Jul 18 16:57:23.129140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 418/737] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:22 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:23.133727 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3a0f21d0-47ca-4413-a719-479a09e0572f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:23.134672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3a0f21d0-47ca-4413-a719-479a09e0572f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:23.140546 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a0f21d0-47ca-4413-a719-479a09e0572f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.140998 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a0f21d0-47ca-4413-a719-479a09e0572f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:23.141755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a0f21d0-47ca-4413-a719-479a09e0572f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.142191 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a0f21d0-47ca-4413-a719-479a09e0572f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:23.173927 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3a0f21d0-47ca-4413-a719-479a09e0572f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043756 Jul 18 16:57:23.174493 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 419/738] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:57:23 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:23.980511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d68e60a8-1cfe-4ed7-aa04-6f4d35c3a64e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:23.981140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d68e60a8-1cfe-4ed7-aa04-6f4d35c3a64e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:23.987319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d68e60a8-1cfe-4ed7-aa04-6f4d35c3a64e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.987726 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d68e60a8-1cfe-4ed7-aa04-6f4d35c3a64e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:23.988484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d68e60a8-1cfe-4ed7-aa04-6f4d35c3a64e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:23.988917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d68e60a8-1cfe-4ed7-aa04-6f4d35c3a64e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:24.119107 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d68e60a8-1cfe-4ed7-aa04-6f4d35c3a64e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:24.127803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d68e60a8-1cfe-4ed7-aa04-6f4d35c3a64e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.151278 Jul 18 16:57:24.128371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 420/739] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:24.145005 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f9461f85-be17-4149-9ff6-7614d177ab51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:24.145597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f9461f85-be17-4149-9ff6-7614d177ab51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:24.151632 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f9461f85-be17-4149-9ff6-7614d177ab51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:24.152076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f9461f85-be17-4149-9ff6-7614d177ab51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:24.152816 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f9461f85-be17-4149-9ff6-7614d177ab51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:24.153245 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f9461f85-be17-4149-9ff6-7614d177ab51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:24.288915 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f9461f85-be17-4149-9ff6-7614d177ab51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:24.297916 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f9461f85-be17-4149-9ff6-7614d177ab51 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.156470 Jul 18 16:57:24.302287 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 421/740] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:24 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:24.302937 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8a5426d5-b955-4df1-9bdf-8408cfc55fb5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:24.303868 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8a5426d5-b955-4df1-9bdf-8408cfc55fb5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:24.309773 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8a5426d5-b955-4df1-9bdf-8408cfc55fb5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:24.310103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8a5426d5-b955-4df1-9bdf-8408cfc55fb5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:24.310851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8a5426d5-b955-4df1-9bdf-8408cfc55fb5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:24.311285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8a5426d5-b955-4df1-9bdf-8408cfc55fb5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:24.341895 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8a5426d5-b955-4df1-9bdf-8408cfc55fb5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042398 Jul 18 16:57:24.342477 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 422/741] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:57:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:25.145607 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0afdc7fa-cb3d-43c2-97ca-7f1fd5a6c7e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:25.146219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0afdc7fa-cb3d-43c2-97ca-7f1fd5a6c7e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:25.152374 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0afdc7fa-cb3d-43c2-97ca-7f1fd5a6c7e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.152822 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0afdc7fa-cb3d-43c2-97ca-7f1fd5a6c7e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.153575 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0afdc7fa-cb3d-43c2-97ca-7f1fd5a6c7e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.154012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0afdc7fa-cb3d-43c2-97ca-7f1fd5a6c7e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.287868 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0afdc7fa-cb3d-43c2-97ca-7f1fd5a6c7e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:25.295271 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0afdc7fa-cb3d-43c2-97ca-7f1fd5a6c7e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.153965 Jul 18 16:57:25.295863 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 423/742] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:25.314170 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-727c5186-e0a4-4ef3-afa4-36f9d1d918c2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:25.314762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-727c5186-e0a4-4ef3-afa4-36f9d1d918c2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:25.320722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-727c5186-e0a4-4ef3-afa4-36f9d1d918c2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.321164 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-727c5186-e0a4-4ef3-afa4-36f9d1d918c2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.321903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-727c5186-e0a4-4ef3-afa4-36f9d1d918c2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.322331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-727c5186-e0a4-4ef3-afa4-36f9d1d918c2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.463429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-727c5186-e0a4-4ef3-afa4-36f9d1d918c2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:25.471584 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-727c5186-e0a4-4ef3-afa4-36f9d1d918c2 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.161501 Jul 18 16:57:25.472153 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 424/743] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:25 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:25.476705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-df041791-5343-484c-b1bd-ea746fd25d42 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:25.477637 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-df041791-5343-484c-b1bd-ea746fd25d42 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:25.483442 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df041791-5343-484c-b1bd-ea746fd25d42 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.484348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df041791-5343-484c-b1bd-ea746fd25d42 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.484761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df041791-5343-484c-b1bd-ea746fd25d42 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:25.485195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-df041791-5343-484c-b1bd-ea746fd25d42 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:25.514457 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-df041791-5343-484c-b1bd-ea746fd25d42 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041292 Jul 18 16:57:25.515644 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 425/744] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:57:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:26.313110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-331454d1-b65b-459f-a8b0-614436770760 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:26.313840 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-331454d1-b65b-459f-a8b0-614436770760 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:26.320199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-331454d1-b65b-459f-a8b0-614436770760 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.320646 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-331454d1-b65b-459f-a8b0-614436770760 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:26.321407 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-331454d1-b65b-459f-a8b0-614436770760 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.321845 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-331454d1-b65b-459f-a8b0-614436770760 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:26.456557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-331454d1-b65b-459f-a8b0-614436770760 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:26.463975 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-331454d1-b65b-459f-a8b0-614436770760 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.155307 Jul 18 16:57:26.464525 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 426/745] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:26 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:26.488856 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-52abf9e2-5ad7-4c56-9e2f-2108610b4aab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:26.489443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-52abf9e2-5ad7-4c56-9e2f-2108610b4aab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:26.495193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52abf9e2-5ad7-4c56-9e2f-2108610b4aab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.495676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52abf9e2-5ad7-4c56-9e2f-2108610b4aab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:26.496413 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52abf9e2-5ad7-4c56-9e2f-2108610b4aab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.496839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52abf9e2-5ad7-4c56-9e2f-2108610b4aab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:26.625300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-52abf9e2-5ad7-4c56-9e2f-2108610b4aab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:26.633494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-52abf9e2-5ad7-4c56-9e2f-2108610b4aab tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.148202 Jul 18 16:57:26.634057 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 427/746] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:26 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:57:26.638542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-73c6e49d-c21b-4828-b6b4-caa132a482cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:26.639435 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-73c6e49d-c21b-4828-b6b4-caa132a482cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:26.645258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c6e49d-c21b-4828-b6b4-caa132a482cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.645699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c6e49d-c21b-4828-b6b4-caa132a482cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:26.646446 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c6e49d-c21b-4828-b6b4-caa132a482cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:26.646875 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-73c6e49d-c21b-4828-b6b4-caa132a482cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:26.675888 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-73c6e49d-c21b-4828-b6b4-caa132a482cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040796 Jul 18 16:57:26.676441 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 428/747] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:57:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:27.481089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a6313f42-664f-4497-878c-c04d7a76b32b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:27.481739 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a6313f42-664f-4497-878c-c04d7a76b32b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:27.488416 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a6313f42-664f-4497-878c-c04d7a76b32b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:27.488861 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a6313f42-664f-4497-878c-c04d7a76b32b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.489627 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a6313f42-664f-4497-878c-c04d7a76b32b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:27.490072 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a6313f42-664f-4497-878c-c04d7a76b32b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.623639 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a6313f42-664f-4497-878c-c04d7a76b32b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:27.631547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a6313f42-664f-4497-878c-c04d7a76b32b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.154471 Jul 18 16:57:27.632102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 429/748] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:27.650116 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f365c00d-6a5c-48e6-bf9f-8a6ef315aa48 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:27.650930 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f365c00d-6a5c-48e6-bf9f-8a6ef315aa48 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:27.657155 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f365c00d-6a5c-48e6-bf9f-8a6ef315aa48 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:27.657602 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f365c00d-6a5c-48e6-bf9f-8a6ef315aa48 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.658354 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f365c00d-6a5c-48e6-bf9f-8a6ef315aa48 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:27.658793 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f365c00d-6a5c-48e6-bf9f-8a6ef315aa48 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.786700 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f365c00d-6a5c-48e6-bf9f-8a6ef315aa48 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:57:27.794543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f365c00d-6a5c-48e6-bf9f-8a6ef315aa48 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.148098 Jul 18 16:57:27.795138 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 430/749] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:57:27 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:57:27.799956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-09ae0cdc-cbdb-443b-ba7d-e7c0a9e59a3a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:27.800876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-09ae0cdc-cbdb-443b-ba7d-e7c0a9e59a3a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:27.806572 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09ae0cdc-cbdb-443b-ba7d-e7c0a9e59a3a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:27.807012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09ae0cdc-cbdb-443b-ba7d-e7c0a9e59a3a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.807804 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09ae0cdc-cbdb-443b-ba7d-e7c0a9e59a3a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:27.808232 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09ae0cdc-cbdb-443b-ba7d-e7c0a9e59a3a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:27.838409 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-09ae0cdc-cbdb-443b-ba7d-e7c0a9e59a3a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042216 Jul 18 16:57:27.838963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 431/750] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:57:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:57:28.201975 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:57:28.202700 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:57:28.208889 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:28.209332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:28.210091 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:57:28.210520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:57:28.213165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:31.074246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:34.320315 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:57:34.320954 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 16:57:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 (ip 10.222.0.26) !!! Jul 18 16:57:38.206762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=51 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:38.247859 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=3 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:46.519122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:57:46.519953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 16:57:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 (ip 10.222.0.26) !!! Jul 18 16:58:29.687883 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.objects.instance [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lazy-loading 'services' on Instance uuid 295d078f-10f9-4a6d-a3c4-9636ef01a6f7 {{(pid=124945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:58:29.697296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-83383d4d-2d8f-457a-90db-3befd3477a6e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358" status: 202 len: 0 microversion: 2.1 time: 121.556649 Jul 18 16:58:29.697296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 320/751] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 16:56:28 2022] DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 => generated 0 bytes in 121559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 16:58:29.711955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4e1fa5d6-bcee-42fd-9810-6d9210cdd648 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:29.712682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4e1fa5d6-bcee-42fd-9810-6d9210cdd648 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:29.719415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e1fa5d6-bcee-42fd-9810-6d9210cdd648 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.719911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e1fa5d6-bcee-42fd-9810-6d9210cdd648 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.720672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e1fa5d6-bcee-42fd-9810-6d9210cdd648 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.721110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e1fa5d6-bcee-42fd-9810-6d9210cdd648 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.877029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4e1fa5d6-bcee-42fd-9810-6d9210cdd648 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:29.885669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4e1fa5d6-bcee-42fd-9810-6d9210cdd648 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.189901 Jul 18 16:58:29.886250 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 321/752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:29 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:29.891045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cc6d784f-be37-42cf-8b1b-d320e799c706 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:29.891679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cc6d784f-be37-42cf-8b1b-d320e799c706 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:29.898199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cc6d784f-be37-42cf-8b1b-d320e799c706 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.899913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cc6d784f-be37-42cf-8b1b-d320e799c706 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:29.899913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cc6d784f-be37-42cf-8b1b-d320e799c706 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:29.899913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cc6d784f-be37-42cf-8b1b-d320e799c706 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.068698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cc6d784f-be37-42cf-8b1b-d320e799c706 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:58:30.077455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cc6d784f-be37-42cf-8b1b-d320e799c706 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.190055 Jul 18 16:58:30.078068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 322/753] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:58:29 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:58:30.083711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c1c66456-4e07-4662-8e4d-ff4fba0df238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:30.084745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c1c66456-4e07-4662-8e4d-ff4fba0df238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:30.091214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1c66456-4e07-4662-8e4d-ff4fba0df238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.091702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1c66456-4e07-4662-8e4d-ff4fba0df238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.092472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1c66456-4e07-4662-8e4d-ff4fba0df238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.092900 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1c66456-4e07-4662-8e4d-ff4fba0df238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.127084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c1c66456-4e07-4662-8e4d-ff4fba0df238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047853 Jul 18 16:58:30.127692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 323/754] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:58:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:58:30.132583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:58:30.133065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:58:30.139756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.140226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:30.141079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:58:30.141742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:58:39.693152 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=4 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:40.137685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=8 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:40.172356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:21.260156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b106e2f4-9c08-4874-a3de-2f97fb8f82f3) Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Request method failure captured: Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 HTTP/1.1 Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y7cBe60M8ibbUWQXfIgXfC_znmsA2xIYH5QWtH9SnqjdGB3ly02B4enRqhVJr9CiL5YKT1CtqfOKmIygZlpeIPMuv-pyW_cnpFUWTSCJbpWaDIw--vBqYUfmPyydL1FxFWaqink2N-v91-uDUichqcH49_KP3bD19kG6ve0W6gHpC4 Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 8368f31817254dafaea912485f3aa86b Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 16:59:21.262419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8368f31817254dafaea912485f3aa86b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8368f31817254dafaea912485f3aa86b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}] Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 8368f31817254dafaea912485f3aa86b Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: a9452b2e7f334f0387ecfe7194a7b38b Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 16:59:21.264253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: > Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b106e2f4-9c08-4874-a3de-2f97fb8f82f3) Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'server_id': '295d078f-10f9-4a6d-a3c4-9636ef01a6f7', 'id': '4a466a22-b3b1-4b8f-81fc-a96e25284358'} Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 18 16:59:21.265171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b106e2f4-9c08-4874-a3de-2f97fb8f82f3) Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 16:59:21.266850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b106e2f4-9c08-4874-a3de-2f97fb8f82f3) Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.268681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b106e2f4-9c08-4874-a3de-2f97fb8f82f3) Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.271039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b106e2f4-9c08-4874-a3de-2f97fb8f82f3) Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b106e2f4-9c08-4874-a3de-2f97fb8f82f3) Jul 18 16:59:21.273065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 16:59:21.276205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b106e2f4-9c08-4874-a3de-2f97fb8f82f3) {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 16:59:21.276205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f3204912-6f7c-4024-9fdf-b8e13d25b524 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358" status: 400 len: 269 microversion: 2.1 time: 113.065918 Jul 18 16:59:21.276205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 432/755] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 16:57:28 2022] DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 => generated 269 bytes in 113067 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 16:59:21.276205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e22b1a0b-1a72-49f2-b3df-0fb7c6fa01c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:21.276739 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e22b1a0b-1a72-49f2-b3df-0fb7c6fa01c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:21.278100 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e22b1a0b-1a72-49f2-b3df-0fb7c6fa01c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:21.278550 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e22b1a0b-1a72-49f2-b3df-0fb7c6fa01c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:21.279316 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e22b1a0b-1a72-49f2-b3df-0fb7c6fa01c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:21.279781 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e22b1a0b-1a72-49f2-b3df-0fb7c6fa01c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:21.387307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lazy-loading 'services' on Instance uuid 295d078f-10f9-4a6d-a3c4-9636ef01a6f7 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 16:59:21.436710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e22b1a0b-1a72-49f2-b3df-0fb7c6fa01c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:21.444541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e22b1a0b-1a72-49f2-b3df-0fb7c6fa01c6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.178907 Jul 18 16:59:21.445111 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 433/756] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:21.449566 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-74cb3462-bdbf-4eac-8001-49d7aba2e851 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:21.450169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-74cb3462-bdbf-4eac-8001-49d7aba2e851 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:21.456375 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-74cb3462-bdbf-4eac-8001-49d7aba2e851 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:21.456751 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-74cb3462-bdbf-4eac-8001-49d7aba2e851 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:21.457563 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-74cb3462-bdbf-4eac-8001-49d7aba2e851 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:21.457964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-74cb3462-bdbf-4eac-8001-49d7aba2e851 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:21.589272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-74cb3462-bdbf-4eac-8001-49d7aba2e851 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:21.597978 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-74cb3462-bdbf-4eac-8001-49d7aba2e851 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.151874 Jul 18 16:59:21.598552 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 434/757] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:21 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:21.603345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-44faa4b6-fbe2-46a5-8961-392e0f91b463 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:21.604367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-44faa4b6-fbe2-46a5-8961-392e0f91b463 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:21.610674 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-44faa4b6-fbe2-46a5-8961-392e0f91b463 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:21.611117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-44faa4b6-fbe2-46a5-8961-392e0f91b463 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:21.611927 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-44faa4b6-fbe2-46a5-8961-392e0f91b463 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:21.612428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-44faa4b6-fbe2-46a5-8961-392e0f91b463 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:21.642998 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-44faa4b6-fbe2-46a5-8961-392e0f91b463 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Jul 18 16:59:21.644103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 435/758] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:59:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:22.469721 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6ae7f76b-3063-4aca-b3ad-99a1175ef2c2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:22.470431 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6ae7f76b-3063-4aca-b3ad-99a1175ef2c2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:22.477229 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ae7f76b-3063-4aca-b3ad-99a1175ef2c2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:22.477679 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ae7f76b-3063-4aca-b3ad-99a1175ef2c2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:22.478444 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ae7f76b-3063-4aca-b3ad-99a1175ef2c2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:22.478915 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ae7f76b-3063-4aca-b3ad-99a1175ef2c2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:22.629329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6ae7f76b-3063-4aca-b3ad-99a1175ef2c2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:22.638775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6ae7f76b-3063-4aca-b3ad-99a1175ef2c2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.179847 Jul 18 16:59:22.639749 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 436/759] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:22.645774 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3e287ea6-f5bd-4461-bd33-eccbb6bfe099 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:22.646839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3e287ea6-f5bd-4461-bd33-eccbb6bfe099 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:22.663916 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e287ea6-f5bd-4461-bd33-eccbb6bfe099 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:22.664368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e287ea6-f5bd-4461-bd33-eccbb6bfe099 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:22.665817 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e287ea6-f5bd-4461-bd33-eccbb6bfe099 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:22.665817 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e287ea6-f5bd-4461-bd33-eccbb6bfe099 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:22.833783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3e287ea6-f5bd-4461-bd33-eccbb6bfe099 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:22.842295 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3e287ea6-f5bd-4461-bd33-eccbb6bfe099 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.201508 Jul 18 16:59:22.842871 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 437/760] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:22 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:22.848900 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-af3dad04-0da6-41a9-b355-fec5311a907d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:22.850310 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-af3dad04-0da6-41a9-b355-fec5311a907d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:22.860067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-af3dad04-0da6-41a9-b355-fec5311a907d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:22.863443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-af3dad04-0da6-41a9-b355-fec5311a907d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:22.864402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-af3dad04-0da6-41a9-b355-fec5311a907d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:22.864842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-af3dad04-0da6-41a9-b355-fec5311a907d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:22.900835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-af3dad04-0da6-41a9-b355-fec5311a907d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056893 Jul 18 16:59:22.901437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 438/761] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:59:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:23.660557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-843ef593-e375-4192-aeee-7c2a8b0405da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:23.661700 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-843ef593-e375-4192-aeee-7c2a8b0405da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:23.672203 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-843ef593-e375-4192-aeee-7c2a8b0405da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:23.673028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-843ef593-e375-4192-aeee-7c2a8b0405da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:23.674367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-843ef593-e375-4192-aeee-7c2a8b0405da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:23.675227 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-843ef593-e375-4192-aeee-7c2a8b0405da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:23.812331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-843ef593-e375-4192-aeee-7c2a8b0405da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:23.820565 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-843ef593-e375-4192-aeee-7c2a8b0405da tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.168211 Jul 18 16:59:23.821133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 439/762] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:23.860455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6b9e30ef-deb0-4de0-84c6-7b451ad0ccfe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:23.861067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6b9e30ef-deb0-4de0-84c6-7b451ad0ccfe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:23.870474 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6b9e30ef-deb0-4de0-84c6-7b451ad0ccfe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:23.870916 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6b9e30ef-deb0-4de0-84c6-7b451ad0ccfe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:23.871730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6b9e30ef-deb0-4de0-84c6-7b451ad0ccfe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:23.872227 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6b9e30ef-deb0-4de0-84c6-7b451ad0ccfe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:24.010698 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6b9e30ef-deb0-4de0-84c6-7b451ad0ccfe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:24.018708 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6b9e30ef-deb0-4de0-84c6-7b451ad0ccfe tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.162096 Jul 18 16:59:24.019277 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 440/763] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:23 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 16:59:24.023917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a8086687-721c-4d7e-a3a2-f72bd7541724 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:24.024835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a8086687-721c-4d7e-a3a2-f72bd7541724 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:24.030676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8086687-721c-4d7e-a3a2-f72bd7541724 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:24.031117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8086687-721c-4d7e-a3a2-f72bd7541724 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:24.032002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8086687-721c-4d7e-a3a2-f72bd7541724 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:24.032403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8086687-721c-4d7e-a3a2-f72bd7541724 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:24.062851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a8086687-721c-4d7e-a3a2-f72bd7541724 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 Jul 18 16:59:24.063437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 441/764] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:59:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:24.838558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-570b7dcf-50a6-4a13-badc-a551f8400c58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:24.839031 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-570b7dcf-50a6-4a13-badc-a551f8400c58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:24.844916 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-570b7dcf-50a6-4a13-badc-a551f8400c58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:24.845356 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-570b7dcf-50a6-4a13-badc-a551f8400c58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:24.846161 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-570b7dcf-50a6-4a13-badc-a551f8400c58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:24.847214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-570b7dcf-50a6-4a13-badc-a551f8400c58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:24.979457 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-570b7dcf-50a6-4a13-badc-a551f8400c58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:24.986928 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-570b7dcf-50a6-4a13-badc-a551f8400c58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.152529 Jul 18 16:59:24.987611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 442/765] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:24 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:25.035893 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7d5fe8dc-08f8-4c26-8797-106738d6502f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:25.036503 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7d5fe8dc-08f8-4c26-8797-106738d6502f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:25.042524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d5fe8dc-08f8-4c26-8797-106738d6502f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:25.042980 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d5fe8dc-08f8-4c26-8797-106738d6502f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:25.043828 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d5fe8dc-08f8-4c26-8797-106738d6502f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:25.044264 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d5fe8dc-08f8-4c26-8797-106738d6502f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:25.179927 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7d5fe8dc-08f8-4c26-8797-106738d6502f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:25.191566 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7d5fe8dc-08f8-4c26-8797-106738d6502f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.159447 Jul 18 16:59:25.192157 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 443/766] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:25 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:25.196965 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7af3e3cd-eb68-44a7-9e1c-d8e2e28b92aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:25.197872 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7af3e3cd-eb68-44a7-9e1c-d8e2e28b92aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:25.203795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7af3e3cd-eb68-44a7-9e1c-d8e2e28b92aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:25.204243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7af3e3cd-eb68-44a7-9e1c-d8e2e28b92aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:25.205007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7af3e3cd-eb68-44a7-9e1c-d8e2e28b92aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:25.205438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7af3e3cd-eb68-44a7-9e1c-d8e2e28b92aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:25.236985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7af3e3cd-eb68-44a7-9e1c-d8e2e28b92aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Jul 18 16:59:25.238351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 444/767] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:59:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:26.003688 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-16c78ff8-2d9f-472e-aecc-7f6b095c0c2a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:26.004980 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-16c78ff8-2d9f-472e-aecc-7f6b095c0c2a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:26.011099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-16c78ff8-2d9f-472e-aecc-7f6b095c0c2a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.011580 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-16c78ff8-2d9f-472e-aecc-7f6b095c0c2a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.012337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-16c78ff8-2d9f-472e-aecc-7f6b095c0c2a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.012770 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-16c78ff8-2d9f-472e-aecc-7f6b095c0c2a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.146809 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-16c78ff8-2d9f-472e-aecc-7f6b095c0c2a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:26.154442 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-16c78ff8-2d9f-472e-aecc-7f6b095c0c2a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.154577 Jul 18 16:59:26.154993 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 445/768] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:26.209946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7d86fee1-56bf-4504-ad57-f753a443bc2b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:26.210543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7d86fee1-56bf-4504-ad57-f753a443bc2b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:26.217071 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d86fee1-56bf-4504-ad57-f753a443bc2b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.217543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d86fee1-56bf-4504-ad57-f753a443bc2b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.218303 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d86fee1-56bf-4504-ad57-f753a443bc2b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.218728 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7d86fee1-56bf-4504-ad57-f753a443bc2b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.352221 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7d86fee1-56bf-4504-ad57-f753a443bc2b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:26.360249 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7d86fee1-56bf-4504-ad57-f753a443bc2b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.154771 Jul 18 16:59:26.360807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 446/769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:26 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:26.365973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-db3e67ea-dea0-42ff-b82c-0afa0b34dafa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:26.366887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-db3e67ea-dea0-42ff-b82c-0afa0b34dafa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:26.373167 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-db3e67ea-dea0-42ff-b82c-0afa0b34dafa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.373616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-db3e67ea-dea0-42ff-b82c-0afa0b34dafa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.374386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-db3e67ea-dea0-42ff-b82c-0afa0b34dafa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:26.374818 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-db3e67ea-dea0-42ff-b82c-0afa0b34dafa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:26.413295 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-db3e67ea-dea0-42ff-b82c-0afa0b34dafa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051410 Jul 18 16:59:26.413851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 447/770] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:59:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:27.171517 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5355af4a-845b-483e-a8c7-d45e00664a58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:27.172163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5355af4a-845b-483e-a8c7-d45e00664a58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:27.178117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5355af4a-845b-483e-a8c7-d45e00664a58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.178554 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5355af4a-845b-483e-a8c7-d45e00664a58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.179319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5355af4a-845b-483e-a8c7-d45e00664a58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.179773 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5355af4a-845b-483e-a8c7-d45e00664a58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.316239 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5355af4a-845b-483e-a8c7-d45e00664a58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:27.324422 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5355af4a-845b-483e-a8c7-d45e00664a58 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.157095 Jul 18 16:59:27.324984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 448/771] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:27.377736 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dcb88f91-a3af-405c-b61a-1326bc1e7214 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:27.378338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dcb88f91-a3af-405c-b61a-1326bc1e7214 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:27.385250 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dcb88f91-a3af-405c-b61a-1326bc1e7214 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.385696 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dcb88f91-a3af-405c-b61a-1326bc1e7214 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.386454 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dcb88f91-a3af-405c-b61a-1326bc1e7214 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.386890 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dcb88f91-a3af-405c-b61a-1326bc1e7214 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.406002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:27.519931 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dcb88f91-a3af-405c-b61a-1326bc1e7214 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 16:59:27.528553 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dcb88f91-a3af-405c-b61a-1326bc1e7214 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.154659 Jul 18 16:59:27.529113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 449/772] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 16:59:27 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 16:59:27.533543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9c705083-da5c-47bb-a565-565cf74c6bdf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:27.534448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9c705083-da5c-47bb-a565-565cf74c6bdf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:27.540523 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9c705083-da5c-47bb-a565-565cf74c6bdf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.540963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9c705083-da5c-47bb-a565-565cf74c6bdf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.541722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9c705083-da5c-47bb-a565-565cf74c6bdf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:27.542159 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9c705083-da5c-47bb-a565-565cf74c6bdf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:27.575719 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9c705083-da5c-47bb-a565-565cf74c6bdf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Jul 18 16:59:27.576284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 450/773] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 16:59:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 16:59:28.454294 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 16:59:28.454915 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 16:59:28.461559 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:28.462006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:28.462772 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 16:59:28.463220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 16:59:29.922425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:59:29.923182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 16:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 (ip 10.222.0.26) !!! Jul 18 16:59:31.391983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:38.458691 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=38 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:38.482131 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=12 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:43.823940 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 16:59:43.824597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 16:59:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 (ip 10.222.0.26) !!! Jul 18 17:00:25.837309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:00:25.837973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 (ip 10.222.0.26) !!! Jul 18 17:00:30.151550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7eb18e2e-7e7c-4f19-9f31-71f911347c58) Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Request method failure captured: Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 HTTP/1.1 Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y7cBe60M8ibbUWQXfIgXfC_znmsA2xIYH5QWtH9SnqjdGB3ly02B4enRqhVJr9CiL5YKT1CtqfOKmIygZlpeIPMuv-pyW_cnpFUWTSCJbpWaDIw--vBqYUfmPyydL1FxFWaqink2N-v91-uDUichqcH49_KP3bD19kG6ve0W6gHpC4 Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 8368f31817254dafaea912485f3aa86b Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:00:30.153966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8368f31817254dafaea912485f3aa86b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8368f31817254dafaea912485f3aa86b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}] Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 8368f31817254dafaea912485f3aa86b Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a9452b2e7f334f0387ecfe7194a7b38b Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 17:00:30.155394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7eb18e2e-7e7c-4f19-9f31-71f911347c58) Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'server_id': '295d078f-10f9-4a6d-a3c4-9636ef01a6f7', 'id': '4a466a22-b3b1-4b8f-81fc-a96e25284358'} Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 18 17:00:30.156039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7eb18e2e-7e7c-4f19-9f31-71f911347c58) Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:00:30.157699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7eb18e2e-7e7c-4f19-9f31-71f911347c58) Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:30.160838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7eb18e2e-7e7c-4f19-9f31-71f911347c58) Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:30.162011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7eb18e2e-7e7c-4f19-9f31-71f911347c58) Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7eb18e2e-7e7c-4f19-9f31-71f911347c58) Jul 18 17:00:30.163327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:00:30.164631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7eb18e2e-7e7c-4f19-9f31-71f911347c58) {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:00:30.164631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-88240db4-b7dc-43dc-ba69-b0c0553ff870 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358" status: 400 len: 269 microversion: 2.1 time: 120.027090 Jul 18 17:00:30.164631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 324/774] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 16:58:30 2022] DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 => generated 269 bytes in 120028 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:00:30.164631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7991267a-fed5-4ea6-b92b-bb9655c54a65 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:30.165531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7991267a-fed5-4ea6-b92b-bb9655c54a65 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:30.172089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7991267a-fed5-4ea6-b92b-bb9655c54a65 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.172539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7991267a-fed5-4ea6-b92b-bb9655c54a65 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.173316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7991267a-fed5-4ea6-b92b-bb9655c54a65 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.173751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7991267a-fed5-4ea6-b92b-bb9655c54a65 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.337159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7991267a-fed5-4ea6-b92b-bb9655c54a65 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:30.345352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7991267a-fed5-4ea6-b92b-bb9655c54a65 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1448 microversion: 2.1 time: 0.187289 Jul 18 17:00:30.346038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 325/775] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:30 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1448 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:30.350654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ed356e2d-707f-4213-8c96-5cf8d6f4a42b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:30.351357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ed356e2d-707f-4213-8c96-5cf8d6f4a42b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:30.358378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed356e2d-707f-4213-8c96-5cf8d6f4a42b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.359010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed356e2d-707f-4213-8c96-5cf8d6f4a42b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.359610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed356e2d-707f-4213-8c96-5cf8d6f4a42b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.360048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed356e2d-707f-4213-8c96-5cf8d6f4a42b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.439128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.objects.instance [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lazy-loading 'services' on Instance uuid 295d078f-10f9-4a6d-a3c4-9636ef01a6f7 {{(pid=124945) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:00:30.544519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ed356e2d-707f-4213-8c96-5cf8d6f4a42b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:00:30.551515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ed356e2d-707f-4213-8c96-5cf8d6f4a42b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.204268 Jul 18 17:00:30.552040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 326/776] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:00:30 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:00:30.557639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-45eb1bb1-e13d-4aa2-93ed-2e3167d2db05 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:30.558631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-45eb1bb1-e13d-4aa2-93ed-2e3167d2db05 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:30.564782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45eb1bb1-e13d-4aa2-93ed-2e3167d2db05 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.565231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45eb1bb1-e13d-4aa2-93ed-2e3167d2db05 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.565994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45eb1bb1-e13d-4aa2-93ed-2e3167d2db05 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.566430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45eb1bb1-e13d-4aa2-93ed-2e3167d2db05 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.598616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-45eb1bb1-e13d-4aa2-93ed-2e3167d2db05 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045504 Jul 18 17:00:30.599194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 327/777] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:00:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:00:30.604029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:00:30.604704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:00:30.610856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.611302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:30.612107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:00:30.612543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:00:40.451810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=4 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:40.607892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=8 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:40.631356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=22 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:54.328623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:00:54.329253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:00:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 (ip 10.222.0.26) !!! Jul 18 17:01:06.528135 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:01:06.528821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:01:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 (ip 10.222.0.26) !!! Jul 18 17:01:10.262215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:01:10.262802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:01:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 (ip 10.222.0.26) !!! Jul 18 17:01:22.342882 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.wsgi [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a06ff8b2-0e36-43fc-abfa-cf3cdac5cacb) Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Request method failure captured: Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: request: DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 HTTP/1.1 Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept: application/json Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Accept-Encoding: identity Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Connection: close Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Length: 0 Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Content-Type: application/json Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Host: 10.222.0.26 Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Openstack-System-Scope: None Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Auth-Token: gAAAAABi1Y7cBe60M8ibbUWQXfIgXfC_znmsA2xIYH5QWtH9SnqjdGB3ly02B4enRqhVJr9CiL5YKT1CtqfOKmIygZlpeIPMuv-pyW_cnpFUWTSCJbpWaDIw--vBqYUfmPyydL1FxFWaqink2N-v91-uDUichqcH49_KP3bD19kG6ve0W6gHpC4 Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Id: None Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Domain-Name: None Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Identity-Status: Confirmed Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Is-Admin-Project: True Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Id: default Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Domain-Name: Default Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Id: 8368f31817254dafaea912485f3aa86b Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Role: member,reader Jul 18 17:01:22.347783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Roles: member,reader Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8368f31817254dafaea912485f3aa86b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8368f31817254dafaea912485f3aa86b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}] Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Id: 8368f31817254dafaea912485f3aa86b Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Id: default Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Domain-Name: Default Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Id: a9452b2e7f334f0387ecfe7194a7b38b Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: X-User-Name: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 17:01:22.350475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: method: > Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a06ff8b2-0e36-43fc-abfa-cf3cdac5cacb) Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: action_args: {'server_id': '295d078f-10f9-4a6d-a3c4-9636ef01a6f7', 'id': '4a466a22-b3b1-4b8f-81fc-a96e25284358'} Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 18 17:01:22.351618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a06ff8b2-0e36-43fc-abfa-cf3cdac5cacb) Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:01:22.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a06ff8b2-0e36-43fc-abfa-cf3cdac5cacb) Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.358371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a06ff8b2-0e36-43fc-abfa-cf3cdac5cacb) Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:22.364181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a06ff8b2-0e36-43fc-abfa-cf3cdac5cacb) Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a06ff8b2-0e36-43fc-abfa-cf3cdac5cacb) Jul 18 17:01:22.369184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.374172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a06ff8b2-0e36-43fc-abfa-cf3cdac5cacb) {{(pid=124945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:22.374172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5c5c6759-d4f2-4cf9-b6e4-3c24f8b06920 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358" status: 400 len: 269 microversion: 2.1 time: 114.031505 Jul 18 17:01:22.374172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 451/778] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 16:59:28 2022] DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 => generated 269 bytes in 114040 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:01:22.378510 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dc553518-5e4b-4429-a63e-b6f4d152c249 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:22.378510 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dc553518-5e4b-4429-a63e-b6f4d152c249 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:22.401024 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc553518-5e4b-4429-a63e-b6f4d152c249 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.401979 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc553518-5e4b-4429-a63e-b6f4d152c249 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.404902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc553518-5e4b-4429-a63e-b6f4d152c249 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.405710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc553518-5e4b-4429-a63e-b6f4d152c249 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.549923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dc553518-5e4b-4429-a63e-b6f4d152c249 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:22.562093 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dc553518-5e4b-4429-a63e-b6f4d152c249 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1375 microversion: 2.1 time: 0.201760 Jul 18 17:01:22.568071 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 452/779] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1375 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:22.568876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7a52ed75-3f61-4fa5-9832-6ef6d4ec9cda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:22.571859 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7a52ed75-3f61-4fa5-9832-6ef6d4ec9cda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:22.600857 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a52ed75-3f61-4fa5-9832-6ef6d4ec9cda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.616445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a52ed75-3f61-4fa5-9832-6ef6d4ec9cda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.616445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a52ed75-3f61-4fa5-9832-6ef6d4ec9cda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.616445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a52ed75-3f61-4fa5-9832-6ef6d4ec9cda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.629153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lazy-loading 'services' on Instance uuid 295d078f-10f9-4a6d-a3c4-9636ef01a6f7 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:01:22.823807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7a52ed75-3f61-4fa5-9832-6ef6d4ec9cda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:22.836627 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2a70f3-8c09-4a94-8ae7-9f5693d44cd1) Jul 18 17:01:22.836803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7a52ed75-3f61-4fa5-9832-6ef6d4ec9cda tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.271381 Jul 18 17:01:22.836803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 453/780] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:22 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Request method failure captured: Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 HTTP/1.1 Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y7cBe60M8ibbUWQXfIgXfC_znmsA2xIYH5QWtH9SnqjdGB3ly02B4enRqhVJr9CiL5YKT1CtqfOKmIygZlpeIPMuv-pyW_cnpFUWTSCJbpWaDIw--vBqYUfmPyydL1FxFWaqink2N-v91-uDUichqcH49_KP3bD19kG6ve0W6gHpC4 Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 8368f31817254dafaea912485f3aa86b Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:01:22.837108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8368f31817254dafaea912485f3aa86b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8368f31817254dafaea912485f3aa86b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}] Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 8368f31817254dafaea912485f3aa86b Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a9452b2e7f334f0387ecfe7194a7b38b Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 17:01:22.839524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2a70f3-8c09-4a94-8ae7-9f5693d44cd1) Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'server_id': '295d078f-10f9-4a6d-a3c4-9636ef01a6f7', 'id': '4a466a22-b3b1-4b8f-81fc-a96e25284358'} Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 18 17:01:22.841243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2a70f3-8c09-4a94-8ae7-9f5693d44cd1) Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 17:01:22.843481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2a70f3-8c09-4a94-8ae7-9f5693d44cd1) Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.845585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2a70f3-8c09-4a94-8ae7-9f5693d44cd1) Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:22.847455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2a70f3-8c09-4a94-8ae7-9f5693d44cd1) Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2a70f3-8c09-4a94-8ae7-9f5693d44cd1) Jul 18 17:01:22.851576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:01:22.855276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc2a70f3-8c09-4a94-8ae7-9f5693d44cd1) {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:01:22.855276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b7607817-2b8c-4f82-8641-a32a20948078 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358" status: 400 len: 269 microversion: 2.1 time: 52.238261 Jul 18 17:01:22.855276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 328/781] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 17:00:30 2022] DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7/os-volume_attachments/4a466a22-b3b1-4b8f-81fc-a96e25284358 => generated 269 bytes in 52240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:01:22.855778 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cc6bc908-c65f-438a-b85d-019aaa6ac213 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:22.855778 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cc6bc908-c65f-438a-b85d-019aaa6ac213 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:22.857218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc6bc908-c65f-438a-b85d-019aaa6ac213 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.857891 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc6bc908-c65f-438a-b85d-019aaa6ac213 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.858748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc6bc908-c65f-438a-b85d-019aaa6ac213 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.859271 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc6bc908-c65f-438a-b85d-019aaa6ac213 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.908413 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cc6bc908-c65f-438a-b85d-019aaa6ac213 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070724 Jul 18 17:01:22.913520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 454/782] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:22.948411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-513c5b1c-dac6-4132-a2ac-fc6144d65215 req-122d0f9f-d54b-4ead-98fd-03daa36ca6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1c9245-f7e5-4ff8-b561-7dc29e139931", "name": "network-vif-deleted", "tag": "58e840d1-84ce-4ac8-bb93-2ee5a430d89d"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:01:22.958076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-513c5b1c-dac6-4132-a2ac-fc6144d65215 req-122d0f9f-d54b-4ead-98fd-03daa36ca6d5 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:22.958519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-513c5b1c-dac6-4132-a2ac-fc6144d65215 req-122d0f9f-d54b-4ead-98fd-03daa36ca6d5 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:22.971949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-513c5b1c-dac6-4132-a2ac-fc6144d65215 req-122d0f9f-d54b-4ead-98fd-03daa36ca6d5 service nova] Creating event network-vif-deleted:58e840d1-84ce-4ac8-bb93-2ee5a430d89d for instance 6f1c9245-f7e5-4ff8-b561-7dc29e139931 on hv-cinder-84617 Jul 18 17:01:22.978549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-513c5b1c-dac6-4132-a2ac-fc6144d65215 req-122d0f9f-d54b-4ead-98fd-03daa36ca6d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124842 Jul 18 17:01:22.979455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 329/783] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:23.606235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3c39dd45-b8b5-428d-954f-f155cb2d92a9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:23.607390 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3c39dd45-b8b5-428d-954f-f155cb2d92a9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:23.615449 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3c39dd45-b8b5-428d-954f-f155cb2d92a9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:23.616068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3c39dd45-b8b5-428d-954f-f155cb2d92a9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:23.617178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3c39dd45-b8b5-428d-954f-f155cb2d92a9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:23.617739 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3c39dd45-b8b5-428d-954f-f155cb2d92a9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:23.705690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3c39dd45-b8b5-428d-954f-f155cb2d92a9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:23.714110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3c39dd45-b8b5-428d-954f-f155cb2d92a9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.124331 Jul 18 17:01:23.715101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 455/784] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:23.867198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-66a7b63b-a612-4a84-8a28-cc0f0cedcca3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:23.868177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-66a7b63b-a612-4a84-8a28-cc0f0cedcca3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:23.875465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66a7b63b-a612-4a84-8a28-cc0f0cedcca3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:23.875950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66a7b63b-a612-4a84-8a28-cc0f0cedcca3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:23.876736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66a7b63b-a612-4a84-8a28-cc0f0cedcca3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:23.877175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66a7b63b-a612-4a84-8a28-cc0f0cedcca3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:23.922138 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b971ef4b-b7ac-4a38-a429-76ce2c3781e5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:23.923525 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b971ef4b-b7ac-4a38-a429-76ce2c3781e5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:23.932445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b971ef4b-b7ac-4a38-a429-76ce2c3781e5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:23.932918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b971ef4b-b7ac-4a38-a429-76ce2c3781e5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:23.933677 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b971ef4b-b7ac-4a38-a429-76ce2c3781e5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:23.934654 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b971ef4b-b7ac-4a38-a429-76ce2c3781e5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:23.992137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b971ef4b-b7ac-4a38-a429-76ce2c3781e5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074367 Jul 18 17:01:23.993163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 456/785] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:23 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:24.041664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-66a7b63b-a612-4a84-8a28-cc0f0cedcca3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:24.050968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-66a7b63b-a612-4a84-8a28-cc0f0cedcca3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.188622 Jul 18 17:01:24.051613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 330/786] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:23 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:24.733693 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-320f1067-08d4-4712-9ab6-d603c6b0ce8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:24.734243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-320f1067-08d4-4712-9ab6-d603c6b0ce8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:24.741090 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-320f1067-08d4-4712-9ab6-d603c6b0ce8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:24.741567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-320f1067-08d4-4712-9ab6-d603c6b0ce8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:24.742331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-320f1067-08d4-4712-9ab6-d603c6b0ce8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:24.742775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-320f1067-08d4-4712-9ab6-d603c6b0ce8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:24.812421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-320f1067-08d4-4712-9ab6-d603c6b0ce8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:24.821288 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-320f1067-08d4-4712-9ab6-d603c6b0ce8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.092280 Jul 18 17:01:24.821885 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 457/787] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:24 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:25.006720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2e4e1dfb-c25e-40c5-891b-c12d307b5de8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:25.007782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2e4e1dfb-c25e-40c5-891b-c12d307b5de8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:25.016753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2e4e1dfb-c25e-40c5-891b-c12d307b5de8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:25.017235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2e4e1dfb-c25e-40c5-891b-c12d307b5de8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:25.018082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2e4e1dfb-c25e-40c5-891b-c12d307b5de8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:25.018567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2e4e1dfb-c25e-40c5-891b-c12d307b5de8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:25.056650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2e4e1dfb-c25e-40c5-891b-c12d307b5de8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053889 Jul 18 17:01:25.057255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 331/788] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:25.081438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-79f5007f-021c-4676-a042-0f84ba969b4d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:25.082472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-79f5007f-021c-4676-a042-0f84ba969b4d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:25.092690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-79f5007f-021c-4676-a042-0f84ba969b4d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:25.093133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-79f5007f-021c-4676-a042-0f84ba969b4d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:25.093901 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-79f5007f-021c-4676-a042-0f84ba969b4d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:25.094334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-79f5007f-021c-4676-a042-0f84ba969b4d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:25.266034 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-79f5007f-021c-4676-a042-0f84ba969b4d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:25.274342 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-79f5007f-021c-4676-a042-0f84ba969b4d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.201255 Jul 18 17:01:25.274918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 458/789] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:25 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:25.841988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0d587d22-e66b-44e8-bde0-869d9a0ff1b9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:25.842595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0d587d22-e66b-44e8-bde0-869d9a0ff1b9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:25.849737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d587d22-e66b-44e8-bde0-869d9a0ff1b9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:25.850182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d587d22-e66b-44e8-bde0-869d9a0ff1b9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:25.850962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d587d22-e66b-44e8-bde0-869d9a0ff1b9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:25.851400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d587d22-e66b-44e8-bde0-869d9a0ff1b9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:25.922432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0d587d22-e66b-44e8-bde0-869d9a0ff1b9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:25.930817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0d587d22-e66b-44e8-bde0-869d9a0ff1b9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.094112 Jul 18 17:01:25.931418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 332/790] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:26.068659 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-21943346-85ad-40e7-ac72-99bd2e498cab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:26.069491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-21943346-85ad-40e7-ac72-99bd2e498cab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:26.077209 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-21943346-85ad-40e7-ac72-99bd2e498cab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:26.077650 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-21943346-85ad-40e7-ac72-99bd2e498cab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:26.078448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-21943346-85ad-40e7-ac72-99bd2e498cab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:26.078876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-21943346-85ad-40e7-ac72-99bd2e498cab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:26.111755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-21943346-85ad-40e7-ac72-99bd2e498cab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046969 Jul 18 17:01:26.112335 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 459/791] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:26.299234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7d4f30dc-2935-437a-a606-a8c12963960e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:26.301018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7d4f30dc-2935-437a-a606-a8c12963960e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:26.306816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d4f30dc-2935-437a-a606-a8c12963960e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:26.307268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d4f30dc-2935-437a-a606-a8c12963960e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:26.308089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d4f30dc-2935-437a-a606-a8c12963960e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:26.308562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d4f30dc-2935-437a-a606-a8c12963960e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:26.458491 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7d4f30dc-2935-437a-a606-a8c12963960e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:26.468820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7d4f30dc-2935-437a-a606-a8c12963960e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.173708 Jul 18 17:01:26.469409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 333/792] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:26 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:26.948926 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3c6ec197-d884-4db5-a97d-bd9459ccb48b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:26.949733 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3c6ec197-d884-4db5-a97d-bd9459ccb48b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:26.956313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3c6ec197-d884-4db5-a97d-bd9459ccb48b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:26.956788 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3c6ec197-d884-4db5-a97d-bd9459ccb48b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:26.957562 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3c6ec197-d884-4db5-a97d-bd9459ccb48b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:26.957994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3c6ec197-d884-4db5-a97d-bd9459ccb48b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:27.029020 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3c6ec197-d884-4db5-a97d-bd9459ccb48b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:27.042933 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3c6ec197-d884-4db5-a97d-bd9459ccb48b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.097492 Jul 18 17:01:27.044062 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 460/793] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:26 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:27.250682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-40279549-ac31-4b63-88e3-f81a308cb679 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:27.251722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-40279549-ac31-4b63-88e3-f81a308cb679 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:27.258131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40279549-ac31-4b63-88e3-f81a308cb679 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:27.258578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40279549-ac31-4b63-88e3-f81a308cb679 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:27.259357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40279549-ac31-4b63-88e3-f81a308cb679 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:27.259812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40279549-ac31-4b63-88e3-f81a308cb679 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:27.295712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-40279549-ac31-4b63-88e3-f81a308cb679 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175344 Jul 18 17:01:27.296308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 334/794] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:27.490699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7312ad4c-25fa-4158-9b82-0c35e28f9db7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:27.491834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7312ad4c-25fa-4158-9b82-0c35e28f9db7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:27.504146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7312ad4c-25fa-4158-9b82-0c35e28f9db7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:27.504952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7312ad4c-25fa-4158-9b82-0c35e28f9db7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:27.506348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7312ad4c-25fa-4158-9b82-0c35e28f9db7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:27.507112 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7312ad4c-25fa-4158-9b82-0c35e28f9db7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:27.674869 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7312ad4c-25fa-4158-9b82-0c35e28f9db7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:27.683515 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7312ad4c-25fa-4158-9b82-0c35e28f9db7 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.200128 Jul 18 17:01:27.684934 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 461/795] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:27 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:28.069577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-69b80945-6100-4988-bc19-660347632105 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:28.070153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-69b80945-6100-4988-bc19-660347632105 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:28.077862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69b80945-6100-4988-bc19-660347632105 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:28.078313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69b80945-6100-4988-bc19-660347632105 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:28.079110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69b80945-6100-4988-bc19-660347632105 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:28.079585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69b80945-6100-4988-bc19-660347632105 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:28.148358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69b80945-6100-4988-bc19-660347632105 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:28.156833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-69b80945-6100-4988-bc19-660347632105 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.091142 Jul 18 17:01:28.157428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 335/796] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:28 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:28.308186 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b78339ca-f65c-4850-9789-6ae186a7c2fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:28.310460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b78339ca-f65c-4850-9789-6ae186a7c2fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:28.316937 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b78339ca-f65c-4850-9789-6ae186a7c2fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:28.317375 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b78339ca-f65c-4850-9789-6ae186a7c2fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:28.318210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b78339ca-f65c-4850-9789-6ae186a7c2fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:28.318639 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b78339ca-f65c-4850-9789-6ae186a7c2fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:28.352392 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b78339ca-f65c-4850-9789-6ae186a7c2fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048074 Jul 18 17:01:28.352976 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 462/797] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:28 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:28.827310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-407860ce-e2dc-48cb-9f20-88d28d0ffd3d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:28.827966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-407860ce-e2dc-48cb-9f20-88d28d0ffd3d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:28.834590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-407860ce-e2dc-48cb-9f20-88d28d0ffd3d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:28.835089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-407860ce-e2dc-48cb-9f20-88d28d0ffd3d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:28.835934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-407860ce-e2dc-48cb-9f20-88d28d0ffd3d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:28.836379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-407860ce-e2dc-48cb-9f20-88d28d0ffd3d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:28.985172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-407860ce-e2dc-48cb-9f20-88d28d0ffd3d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:28.993881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-407860ce-e2dc-48cb-9f20-88d28d0ffd3d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.295861 Jul 18 17:01:28.994628 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 336/798] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:28 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:29.179061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a45a8e27-9e7a-40c9-9793-0f51e02f27b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:29.180205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a45a8e27-9e7a-40c9-9793-0f51e02f27b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:29.192161 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a45a8e27-9e7a-40c9-9793-0f51e02f27b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:29.192976 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a45a8e27-9e7a-40c9-9793-0f51e02f27b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:29.194399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a45a8e27-9e7a-40c9-9793-0f51e02f27b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:29.195281 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a45a8e27-9e7a-40c9-9793-0f51e02f27b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:29.271271 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a45a8e27-9e7a-40c9-9793-0f51e02f27b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:29.280496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a45a8e27-9e7a-40c9-9793-0f51e02f27b8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.109537 Jul 18 17:01:29.281225 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 463/799] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:29 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:29.365433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e1945338-511d-4f0f-9fc6-49657c4af298 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:29.366425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e1945338-511d-4f0f-9fc6-49657c4af298 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:29.374224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e1945338-511d-4f0f-9fc6-49657c4af298 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:29.374673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e1945338-511d-4f0f-9fc6-49657c4af298 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:29.375447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e1945338-511d-4f0f-9fc6-49657c4af298 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:29.375912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e1945338-511d-4f0f-9fc6-49657c4af298 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:29.413097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e1945338-511d-4f0f-9fc6-49657c4af298 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051532 Jul 18 17:01:29.413670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 337/800] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:29 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:30.012578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-60d0feb8-82cd-4ed5-a95a-ebbe72f37b25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:30.013309 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-60d0feb8-82cd-4ed5-a95a-ebbe72f37b25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:30.020510 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60d0feb8-82cd-4ed5-a95a-ebbe72f37b25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:30.020955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60d0feb8-82cd-4ed5-a95a-ebbe72f37b25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:30.021725 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60d0feb8-82cd-4ed5-a95a-ebbe72f37b25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:30.022163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60d0feb8-82cd-4ed5-a95a-ebbe72f37b25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:30.168613 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-60d0feb8-82cd-4ed5-a95a-ebbe72f37b25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:30.177381 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-60d0feb8-82cd-4ed5-a95a-ebbe72f37b25 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.168730 Jul 18 17:01:30.178028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 464/801] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:30 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:30.300423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8334286c-b12b-45c4-a026-3bc8df299fe0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:30.301114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8334286c-b12b-45c4-a026-3bc8df299fe0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:30.308672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8334286c-b12b-45c4-a026-3bc8df299fe0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:30.309759 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8334286c-b12b-45c4-a026-3bc8df299fe0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:30.310871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8334286c-b12b-45c4-a026-3bc8df299fe0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:30.311432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8334286c-b12b-45c4-a026-3bc8df299fe0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:30.383557 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8334286c-b12b-45c4-a026-3bc8df299fe0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:30.392507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8334286c-b12b-45c4-a026-3bc8df299fe0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.097714 Jul 18 17:01:30.393091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 338/802] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:30 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:30.426901 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1dc5c4e8-63e9-4d54-9712-191fb51ef107 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:30.427910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1dc5c4e8-63e9-4d54-9712-191fb51ef107 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:30.434794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1dc5c4e8-63e9-4d54-9712-191fb51ef107 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:30.435237 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1dc5c4e8-63e9-4d54-9712-191fb51ef107 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:30.436358 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1dc5c4e8-63e9-4d54-9712-191fb51ef107 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:30.436801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1dc5c4e8-63e9-4d54-9712-191fb51ef107 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:30.471376 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1dc5c4e8-63e9-4d54-9712-191fb51ef107 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048944 Jul 18 17:01:30.472102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 465/803] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:31.205098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4c1eb9b2-4734-4bd3-85ca-faf9963480d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:31.205614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4c1eb9b2-4734-4bd3-85ca-faf9963480d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:31.212087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c1eb9b2-4734-4bd3-85ca-faf9963480d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.212533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c1eb9b2-4734-4bd3-85ca-faf9963480d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.213303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c1eb9b2-4734-4bd3-85ca-faf9963480d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.213738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c1eb9b2-4734-4bd3-85ca-faf9963480d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.351986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4c1eb9b2-4734-4bd3-85ca-faf9963480d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:31.360816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4c1eb9b2-4734-4bd3-85ca-faf9963480d0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.159548 Jul 18 17:01:31.361384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 339/804] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:31 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:31.409667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-25a317fa-c6af-49b0-a76d-8e6392c32aea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:31.410270 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-25a317fa-c6af-49b0-a76d-8e6392c32aea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:31.416911 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-25a317fa-c6af-49b0-a76d-8e6392c32aea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.417362 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-25a317fa-c6af-49b0-a76d-8e6392c32aea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.418239 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-25a317fa-c6af-49b0-a76d-8e6392c32aea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.418977 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-25a317fa-c6af-49b0-a76d-8e6392c32aea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.484552 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-27127d6f-1215-472d-9592-d5b0ee1cc692 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:31.486219 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-27127d6f-1215-472d-9592-d5b0ee1cc692 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:31.488329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-25a317fa-c6af-49b0-a76d-8e6392c32aea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:31.493267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27127d6f-1215-472d-9592-d5b0ee1cc692 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.493707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27127d6f-1215-472d-9592-d5b0ee1cc692 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.494575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27127d6f-1215-472d-9592-d5b0ee1cc692 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:31.494974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27127d6f-1215-472d-9592-d5b0ee1cc692 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:31.497806 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-25a317fa-c6af-49b0-a76d-8e6392c32aea tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.091854 Jul 18 17:01:31.498547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 466/805] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:31 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:31.532573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-27127d6f-1215-472d-9592-d5b0ee1cc692 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052783 Jul 18 17:01:31.533158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 340/806] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:32.380448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-fadc239d-15af-4349-afd6-71534808dfa4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:32.381051 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-fadc239d-15af-4349-afd6-71534808dfa4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:32.388199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fadc239d-15af-4349-afd6-71534808dfa4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.388643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fadc239d-15af-4349-afd6-71534808dfa4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:32.389401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fadc239d-15af-4349-afd6-71534808dfa4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.389839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fadc239d-15af-4349-afd6-71534808dfa4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:32.517074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ce2ddc0d-ac3d-4326-b502-d9c6a5832c32 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:32.517885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ce2ddc0d-ac3d-4326-b502-d9c6a5832c32 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:32.525822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc0d-ac3d-4326-b502-d9c6a5832c32 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.525822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc0d-ac3d-4326-b502-d9c6a5832c32 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:32.526440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc0d-ac3d-4326-b502-d9c6a5832c32 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.526874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc0d-ac3d-4326-b502-d9c6a5832c32 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:32.529917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-fadc239d-15af-4349-afd6-71534808dfa4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:32.538101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-fadc239d-15af-4349-afd6-71534808dfa4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.162298 Jul 18 17:01:32.539836 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 467/807] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:32 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:32.545176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6e8efa16-a80f-4219-9c0c-f32d18b43260 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:32.546104 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6e8efa16-a80f-4219-9c0c-f32d18b43260 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:32.552595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e8efa16-a80f-4219-9c0c-f32d18b43260 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.553036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e8efa16-a80f-4219-9c0c-f32d18b43260 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:32.553806 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e8efa16-a80f-4219-9c0c-f32d18b43260 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:32.554234 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6e8efa16-a80f-4219-9c0c-f32d18b43260 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:32.571613 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:32.586087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6e8efa16-a80f-4219-9c0c-f32d18b43260 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045211 Jul 18 17:01:32.586661 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 468/808] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:32.595208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ce2ddc0d-ac3d-4326-b502-d9c6a5832c32 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:32.603199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ce2ddc0d-ac3d-4326-b502-d9c6a5832c32 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.091429 Jul 18 17:01:32.603810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 341/809] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:32 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:33.556279 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7103ea47-5258-4b91-93bc-82a6be70e6f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:33.556873 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7103ea47-5258-4b91-93bc-82a6be70e6f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:33.564283 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7103ea47-5258-4b91-93bc-82a6be70e6f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:33.564740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7103ea47-5258-4b91-93bc-82a6be70e6f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:33.565512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7103ea47-5258-4b91-93bc-82a6be70e6f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:33.565952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7103ea47-5258-4b91-93bc-82a6be70e6f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:33.598382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e4e601e2-9581-4d1a-a94b-afc49b1d929e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:33.599393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e4e601e2-9581-4d1a-a94b-afc49b1d929e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:33.606452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e4e601e2-9581-4d1a-a94b-afc49b1d929e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:33.607085 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e4e601e2-9581-4d1a-a94b-afc49b1d929e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:33.607967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e4e601e2-9581-4d1a-a94b-afc49b1d929e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:33.608423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e4e601e2-9581-4d1a-a94b-afc49b1d929e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:33.640460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e4e601e2-9581-4d1a-a94b-afc49b1d929e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046001 Jul 18 17:01:33.641043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 342/810] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:33 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:33.645745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5325b21d-2a6e-47a8-abc3-bff6383cc99c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:33.646375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5325b21d-2a6e-47a8-abc3-bff6383cc99c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:33.653227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5325b21d-2a6e-47a8-abc3-bff6383cc99c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:33.656412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5325b21d-2a6e-47a8-abc3-bff6383cc99c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:33.656412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5325b21d-2a6e-47a8-abc3-bff6383cc99c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:33.656412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5325b21d-2a6e-47a8-abc3-bff6383cc99c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:33.703255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7103ea47-5258-4b91-93bc-82a6be70e6f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:33.714480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7103ea47-5258-4b91-93bc-82a6be70e6f9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.161989 Jul 18 17:01:33.720755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 469/811] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:33 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:33.729467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5325b21d-2a6e-47a8-abc3-bff6383cc99c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:33.744303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5325b21d-2a6e-47a8-abc3-bff6383cc99c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.102185 Jul 18 17:01:33.745106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 343/812] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:34.653136 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-63b6b971-ff11-4e5b-80e4-bb1469847d60 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:34.654083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-63b6b971-ff11-4e5b-80e4-bb1469847d60 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:34.660499 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63b6b971-ff11-4e5b-80e4-bb1469847d60 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.661010 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63b6b971-ff11-4e5b-80e4-bb1469847d60 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.661804 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63b6b971-ff11-4e5b-80e4-bb1469847d60 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.662276 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63b6b971-ff11-4e5b-80e4-bb1469847d60 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.693534 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-63b6b971-ff11-4e5b-80e4-bb1469847d60 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Jul 18 17:01:34.694089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 470/813] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:34 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:34.731810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-845e9fa2-d486-484a-8118-64a8fe259fc9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:34.732413 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-845e9fa2-d486-484a-8118-64a8fe259fc9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:34.738957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-845e9fa2-d486-484a-8118-64a8fe259fc9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.739528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-845e9fa2-d486-484a-8118-64a8fe259fc9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.740207 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-845e9fa2-d486-484a-8118-64a8fe259fc9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.740651 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-845e9fa2-d486-484a-8118-64a8fe259fc9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.761325 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f46c98a9-2447-483f-a56b-31da1eef852e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:34.762159 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f46c98a9-2447-483f-a56b-31da1eef852e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:34.768512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f46c98a9-2447-483f-a56b-31da1eef852e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.768955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f46c98a9-2447-483f-a56b-31da1eef852e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.769714 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f46c98a9-2447-483f-a56b-31da1eef852e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:34.770144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f46c98a9-2447-483f-a56b-31da1eef852e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:34.836633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f46c98a9-2447-483f-a56b-31da1eef852e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:34.845061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f46c98a9-2447-483f-a56b-31da1eef852e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.087425 Jul 18 17:01:34.845640 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 471/814] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:34 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:34.880920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-845e9fa2-d486-484a-8118-64a8fe259fc9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:34.889490 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-845e9fa2-d486-484a-8118-64a8fe259fc9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.162192 Jul 18 17:01:34.890062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 344/815] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:34 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:35.704724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b1721472-e0be-43b9-8305-adfe596ced92 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:35.705649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b1721472-e0be-43b9-8305-adfe596ced92 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:35.711895 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b1721472-e0be-43b9-8305-adfe596ced92 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.712345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b1721472-e0be-43b9-8305-adfe596ced92 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.713125 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b1721472-e0be-43b9-8305-adfe596ced92 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.713560 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b1721472-e0be-43b9-8305-adfe596ced92 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.747629 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b1721472-e0be-43b9-8305-adfe596ced92 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046957 Jul 18 17:01:35.748214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 472/816] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:35.862359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-99925ec0-876e-4d02-83a3-690f182ba0a1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:35.863104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-99925ec0-876e-4d02-83a3-690f182ba0a1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:35.872343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-99925ec0-876e-4d02-83a3-690f182ba0a1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.872798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-99925ec0-876e-4d02-83a3-690f182ba0a1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.873584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-99925ec0-876e-4d02-83a3-690f182ba0a1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.874023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-99925ec0-876e-4d02-83a3-690f182ba0a1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.895376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:35.912014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f719feeb-07ad-48ae-816c-5c787820094f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:35.913324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f719feeb-07ad-48ae-816c-5c787820094f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:35.923484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f719feeb-07ad-48ae-816c-5c787820094f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.923959 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f719feeb-07ad-48ae-816c-5c787820094f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.924825 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f719feeb-07ad-48ae-816c-5c787820094f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:35.925288 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f719feeb-07ad-48ae-816c-5c787820094f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:35.946858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-99925ec0-876e-4d02-83a3-690f182ba0a1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:35.957755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-99925ec0-876e-4d02-83a3-690f182ba0a1 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.099033 Jul 18 17:01:35.958361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 345/817] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:35 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:36.084846 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f719feeb-07ad-48ae-816c-5c787820094f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:36.095746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f719feeb-07ad-48ae-816c-5c787820094f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.190754 Jul 18 17:01:36.096337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 473/818] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:35 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:36.758707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b0958610-be04-43de-9844-32c6570b78b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:36.759684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b0958610-be04-43de-9844-32c6570b78b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:36.766667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0958610-be04-43de-9844-32c6570b78b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.767283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0958610-be04-43de-9844-32c6570b78b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.768004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0958610-be04-43de-9844-32c6570b78b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.768434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0958610-be04-43de-9844-32c6570b78b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.805338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b0958610-be04-43de-9844-32c6570b78b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050242 Jul 18 17:01:36.805945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 346/819] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:36 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:36.975522 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c6b644b2-1e5b-4118-80e5-ac5b46a96b8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:36.976177 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c6b644b2-1e5b-4118-80e5-ac5b46a96b8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:36.982461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c6b644b2-1e5b-4118-80e5-ac5b46a96b8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.982900 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c6b644b2-1e5b-4118-80e5-ac5b46a96b8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:36.983713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c6b644b2-1e5b-4118-80e5-ac5b46a96b8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:36.984143 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c6b644b2-1e5b-4118-80e5-ac5b46a96b8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.053995 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c6b644b2-1e5b-4118-80e5-ac5b46a96b8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:37.062281 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c6b644b2-1e5b-4118-80e5-ac5b46a96b8a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.090648 Jul 18 17:01:37.062883 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 474/820] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:36 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:37.114018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-83b36f7a-c3a0-4d12-8c44-4591864c5456 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:37.114630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-83b36f7a-c3a0-4d12-8c44-4591864c5456 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:37.122217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83b36f7a-c3a0-4d12-8c44-4591864c5456 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:37.122644 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83b36f7a-c3a0-4d12-8c44-4591864c5456 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.123437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83b36f7a-c3a0-4d12-8c44-4591864c5456 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:37.123907 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83b36f7a-c3a0-4d12-8c44-4591864c5456 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.281172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-83b36f7a-c3a0-4d12-8c44-4591864c5456 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:37.289965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-83b36f7a-c3a0-4d12-8c44-4591864c5456 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.179696 Jul 18 17:01:37.290566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 347/821] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:37 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:37.818428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8b5fa4dd-d8aa-40c2-add6-7abe5474af3f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:37.819378 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8b5fa4dd-d8aa-40c2-add6-7abe5474af3f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:37.825853 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b5fa4dd-d8aa-40c2-add6-7abe5474af3f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:37.826439 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b5fa4dd-d8aa-40c2-add6-7abe5474af3f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.827204 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b5fa4dd-d8aa-40c2-add6-7abe5474af3f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:37.827699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b5fa4dd-d8aa-40c2-add6-7abe5474af3f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:37.860652 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8b5fa4dd-d8aa-40c2-add6-7abe5474af3f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Jul 18 17:01:37.861220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 475/822] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:37 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:38.079279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b79add1d-23df-4b87-be7b-8666c11fd217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:38.079831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b79add1d-23df-4b87-be7b-8666c11fd217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:38.086051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b79add1d-23df-4b87-be7b-8666c11fd217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.086502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b79add1d-23df-4b87-be7b-8666c11fd217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.087280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b79add1d-23df-4b87-be7b-8666c11fd217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.087750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b79add1d-23df-4b87-be7b-8666c11fd217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.155942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b79add1d-23df-4b87-be7b-8666c11fd217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:38.161791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b79add1d-23df-4b87-be7b-8666c11fd217 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.086420 Jul 18 17:01:38.162378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 348/823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:38 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:38.308067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d243d89a-dde0-413d-ba14-5e6e735c4c24 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:38.308712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d243d89a-dde0-413d-ba14-5e6e735c4c24 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:38.314897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d243d89a-dde0-413d-ba14-5e6e735c4c24 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.315337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d243d89a-dde0-413d-ba14-5e6e735c4c24 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.316144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d243d89a-dde0-413d-ba14-5e6e735c4c24 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.316581 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d243d89a-dde0-413d-ba14-5e6e735c4c24 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.449591 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d243d89a-dde0-413d-ba14-5e6e735c4c24 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:38.458358 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d243d89a-dde0-413d-ba14-5e6e735c4c24 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.154189 Jul 18 17:01:38.459044 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 476/824] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:38 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:38.872962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-04354877-c7aa-4fd0-8743-5c9057514586 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:38.873917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-04354877-c7aa-4fd0-8743-5c9057514586 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:38.880373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-04354877-c7aa-4fd0-8743-5c9057514586 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.880856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-04354877-c7aa-4fd0-8743-5c9057514586 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.881643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-04354877-c7aa-4fd0-8743-5c9057514586 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:38.882081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-04354877-c7aa-4fd0-8743-5c9057514586 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:38.913669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-04354877-c7aa-4fd0-8743-5c9057514586 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045123 Jul 18 17:01:38.914254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 349/825] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:38 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:39.179638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-76ef35e1-b079-41d1-9488-ccea9c7d7caa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:39.180269 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-76ef35e1-b079-41d1-9488-ccea9c7d7caa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:39.187368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-76ef35e1-b079-41d1-9488-ccea9c7d7caa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.187843 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-76ef35e1-b079-41d1-9488-ccea9c7d7caa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.188601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-76ef35e1-b079-41d1-9488-ccea9c7d7caa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.189031 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-76ef35e1-b079-41d1-9488-ccea9c7d7caa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.257381 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-76ef35e1-b079-41d1-9488-ccea9c7d7caa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:39.265736 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-76ef35e1-b079-41d1-9488-ccea9c7d7caa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.090380 Jul 18 17:01:39.266323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 477/826] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:39 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:39.476463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-832b4a21-90f2-4555-8816-e28e8d78e050 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:39.477041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-832b4a21-90f2-4555-8816-e28e8d78e050 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:39.485712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-832b4a21-90f2-4555-8816-e28e8d78e050 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.486157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-832b4a21-90f2-4555-8816-e28e8d78e050 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.486926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-832b4a21-90f2-4555-8816-e28e8d78e050 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.487357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-832b4a21-90f2-4555-8816-e28e8d78e050 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.624834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-832b4a21-90f2-4555-8816-e28e8d78e050 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:39.633456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-832b4a21-90f2-4555-8816-e28e8d78e050 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.160869 Jul 18 17:01:39.634018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 350/827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:39 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:39.925918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-54c4bf8a-78af-4ab2-bfb6-8fb23f3bbf9c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:39.926828 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-54c4bf8a-78af-4ab2-bfb6-8fb23f3bbf9c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:39.933128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54c4bf8a-78af-4ab2-bfb6-8fb23f3bbf9c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.934315 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54c4bf8a-78af-4ab2-bfb6-8fb23f3bbf9c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.935333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54c4bf8a-78af-4ab2-bfb6-8fb23f3bbf9c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:39.935787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54c4bf8a-78af-4ab2-bfb6-8fb23f3bbf9c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:39.967713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-54c4bf8a-78af-4ab2-bfb6-8fb23f3bbf9c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045934 Jul 18 17:01:39.968284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 478/828] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:39 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:40.283829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4af92063-9219-41ef-a354-0addc0a206e9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:40.284433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4af92063-9219-41ef-a354-0addc0a206e9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:40.290933 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4af92063-9219-41ef-a354-0addc0a206e9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.291365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4af92063-9219-41ef-a354-0addc0a206e9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:40.292156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4af92063-9219-41ef-a354-0addc0a206e9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.292579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4af92063-9219-41ef-a354-0addc0a206e9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:40.363475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4af92063-9219-41ef-a354-0addc0a206e9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:40.371276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4af92063-9219-41ef-a354-0addc0a206e9 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.091443 Jul 18 17:01:40.371880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 351/829] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:40 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:40.650312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b548aa00-d6cd-440b-bf91-59ab9cf58582 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:40.650823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b548aa00-d6cd-440b-bf91-59ab9cf58582 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:40.657682 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b548aa00-d6cd-440b-bf91-59ab9cf58582 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.658123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b548aa00-d6cd-440b-bf91-59ab9cf58582 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:40.658903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b548aa00-d6cd-440b-bf91-59ab9cf58582 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.659334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b548aa00-d6cd-440b-bf91-59ab9cf58582 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:40.791067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b548aa00-d6cd-440b-bf91-59ab9cf58582 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:40.800149 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b548aa00-d6cd-440b-bf91-59ab9cf58582 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.153705 Jul 18 17:01:40.800713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 479/830] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:40 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:40.980740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b906eab4-b25d-4305-bce7-c944b743d836 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:40.981663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b906eab4-b25d-4305-bce7-c944b743d836 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:40.988645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b906eab4-b25d-4305-bce7-c944b743d836 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.989095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b906eab4-b25d-4305-bce7-c944b743d836 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:40.989877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b906eab4-b25d-4305-bce7-c944b743d836 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:40.990348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b906eab4-b25d-4305-bce7-c944b743d836 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:41.023250 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b906eab4-b25d-4305-bce7-c944b743d836 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047218 Jul 18 17:01:41.023874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 352/831] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:40 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:41.387437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d818853c-efce-4fe4-8529-cb9df3f7d91a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:41.388061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d818853c-efce-4fe4-8529-cb9df3f7d91a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:41.394111 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d818853c-efce-4fe4-8529-cb9df3f7d91a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:41.394558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d818853c-efce-4fe4-8529-cb9df3f7d91a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:41.395363 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d818853c-efce-4fe4-8529-cb9df3f7d91a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:41.395831 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d818853c-efce-4fe4-8529-cb9df3f7d91a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:41.459568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d818853c-efce-4fe4-8529-cb9df3f7d91a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:41.468306 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d818853c-efce-4fe4-8529-cb9df3f7d91a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084751 Jul 18 17:01:41.468880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 480/832] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:41 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:41.817668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7672c69d-3c00-4b24-bd49-3cdace9449dd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:41.818261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7672c69d-3c00-4b24-bd49-3cdace9449dd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:41.825404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7672c69d-3c00-4b24-bd49-3cdace9449dd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:41.826040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7672c69d-3c00-4b24-bd49-3cdace9449dd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:41.826803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7672c69d-3c00-4b24-bd49-3cdace9449dd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:41.827262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7672c69d-3c00-4b24-bd49-3cdace9449dd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:41.969405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7672c69d-3c00-4b24-bd49-3cdace9449dd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:41.977768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7672c69d-3c00-4b24-bd49-3cdace9449dd tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.164155 Jul 18 17:01:41.978376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 353/833] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:41 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:42.034905 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0ba8bbf5-9e89-473c-878c-f2aeb0c3aff3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:42.036010 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0ba8bbf5-9e89-473c-878c-f2aeb0c3aff3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:42.042129 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0ba8bbf5-9e89-473c-878c-f2aeb0c3aff3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.042571 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0ba8bbf5-9e89-473c-878c-f2aeb0c3aff3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.044042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0ba8bbf5-9e89-473c-878c-f2aeb0c3aff3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.044478 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0ba8bbf5-9e89-473c-878c-f2aeb0c3aff3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.076437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0ba8bbf5-9e89-473c-878c-f2aeb0c3aff3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Jul 18 17:01:42.077021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 481/834] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:42 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:42.485972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5a8fbffe-52ec-4880-95da-156517989697 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:42.486507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5a8fbffe-52ec-4880-95da-156517989697 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:42.493653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a8fbffe-52ec-4880-95da-156517989697 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.494103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a8fbffe-52ec-4880-95da-156517989697 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.494871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a8fbffe-52ec-4880-95da-156517989697 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:42.495306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a8fbffe-52ec-4880-95da-156517989697 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:42.584955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5a8fbffe-52ec-4880-95da-156517989697 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:42.594644 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5a8fbffe-52ec-4880-95da-156517989697 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.112375 Jul 18 17:01:42.595433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 354/835] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:42 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:42.995305 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f1825844-1972-4927-8469-c7ce15684494 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:42.996008 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f1825844-1972-4927-8469-c7ce15684494 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:43.002800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f1825844-1972-4927-8469-c7ce15684494 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.003456 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f1825844-1972-4927-8469-c7ce15684494 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.004246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f1825844-1972-4927-8469-c7ce15684494 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.004678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f1825844-1972-4927-8469-c7ce15684494 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.088393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3a1ea519-0ef0-4608-a0de-db2061b10e04 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:43.089288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3a1ea519-0ef0-4608-a0de-db2061b10e04 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:43.096014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a1ea519-0ef0-4608-a0de-db2061b10e04 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.096590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a1ea519-0ef0-4608-a0de-db2061b10e04 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.097364 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a1ea519-0ef0-4608-a0de-db2061b10e04 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.097808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a1ea519-0ef0-4608-a0de-db2061b10e04 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.131175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3a1ea519-0ef0-4608-a0de-db2061b10e04 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046643 Jul 18 17:01:43.132077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 355/836] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:43 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:43.165343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f1825844-1972-4927-8469-c7ce15684494 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:43.181288 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f1825844-1972-4927-8469-c7ce15684494 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.189284 Jul 18 17:01:43.182323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 482/837] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:42 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:43.615522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5208f1c4-5f8a-43a3-83d8-54dace7be759 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:43.617186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5208f1c4-5f8a-43a3-83d8-54dace7be759 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:43.625937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5208f1c4-5f8a-43a3-83d8-54dace7be759 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.626388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5208f1c4-5f8a-43a3-83d8-54dace7be759 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.627203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5208f1c4-5f8a-43a3-83d8-54dace7be759 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:43.627682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5208f1c4-5f8a-43a3-83d8-54dace7be759 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:43.703484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5208f1c4-5f8a-43a3-83d8-54dace7be759 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:43.711917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5208f1c4-5f8a-43a3-83d8-54dace7be759 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.100224 Jul 18 17:01:43.712508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 356/838] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:43 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:44.144219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-62fe447b-945a-4981-bf15-6a8d6fe4d3c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:44.145145 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-62fe447b-945a-4981-bf15-6a8d6fe4d3c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:44.151137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-62fe447b-945a-4981-bf15-6a8d6fe4d3c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.151601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-62fe447b-945a-4981-bf15-6a8d6fe4d3c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.152904 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-62fe447b-945a-4981-bf15-6a8d6fe4d3c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.153347 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-62fe447b-945a-4981-bf15-6a8d6fe4d3c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.184854 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-62fe447b-945a-4981-bf15-6a8d6fe4d3c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Jul 18 17:01:44.185426 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 483/839] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:44 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:44.199963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2a39bf3c-5330-4e40-af37-1d694cc8ddd4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:44.200648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2a39bf3c-5330-4e40-af37-1d694cc8ddd4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:44.206780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2a39bf3c-5330-4e40-af37-1d694cc8ddd4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.207240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2a39bf3c-5330-4e40-af37-1d694cc8ddd4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.208047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2a39bf3c-5330-4e40-af37-1d694cc8ddd4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.208488 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2a39bf3c-5330-4e40-af37-1d694cc8ddd4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.370660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2a39bf3c-5330-4e40-af37-1d694cc8ddd4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:44.384873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2a39bf3c-5330-4e40-af37-1d694cc8ddd4 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.188357 Jul 18 17:01:44.385687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 357/840] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:44 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:44.733621 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bfefce41-cbe1-4b54-a9bd-39409541a668 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:44.734151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bfefce41-cbe1-4b54-a9bd-39409541a668 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:44.753023 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bfefce41-cbe1-4b54-a9bd-39409541a668 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.753651 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bfefce41-cbe1-4b54-a9bd-39409541a668 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.754742 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bfefce41-cbe1-4b54-a9bd-39409541a668 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:44.755354 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bfefce41-cbe1-4b54-a9bd-39409541a668 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:44.854263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bfefce41-cbe1-4b54-a9bd-39409541a668 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:44.862185 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bfefce41-cbe1-4b54-a9bd-39409541a668 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.132924 Jul 18 17:01:44.862762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 484/841] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:44 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:45.197039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a025cf89-43ef-4805-a696-a5fc461847c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:45.198011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a025cf89-43ef-4805-a696-a5fc461847c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:45.206731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a025cf89-43ef-4805-a696-a5fc461847c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.206731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a025cf89-43ef-4805-a696-a5fc461847c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.206731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a025cf89-43ef-4805-a696-a5fc461847c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.207214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a025cf89-43ef-4805-a696-a5fc461847c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.241357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a025cf89-43ef-4805-a696-a5fc461847c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048454 Jul 18 17:01:45.241952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 358/842] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:45 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:45.408036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2af0b093-0663-4c5e-ae8c-6e440adcb342 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:45.408914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2af0b093-0663-4c5e-ae8c-6e440adcb342 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:45.417285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2af0b093-0663-4c5e-ae8c-6e440adcb342 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.418618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2af0b093-0663-4c5e-ae8c-6e440adcb342 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.419804 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2af0b093-0663-4c5e-ae8c-6e440adcb342 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.420392 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2af0b093-0663-4c5e-ae8c-6e440adcb342 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.426598 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:45.566761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2af0b093-0663-4c5e-ae8c-6e440adcb342 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:45.575262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2af0b093-0663-4c5e-ae8c-6e440adcb342 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.173493 Jul 18 17:01:45.575880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 485/843] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:45 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:45.880508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ba5259b8-37ba-45a1-9e5f-f8a1e34db884 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:45.881266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ba5259b8-37ba-45a1-9e5f-f8a1e34db884 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:45.891456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba5259b8-37ba-45a1-9e5f-f8a1e34db884 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.895320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba5259b8-37ba-45a1-9e5f-f8a1e34db884 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.896221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba5259b8-37ba-45a1-9e5f-f8a1e34db884 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:45.896673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba5259b8-37ba-45a1-9e5f-f8a1e34db884 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:45.974167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ba5259b8-37ba-45a1-9e5f-f8a1e34db884 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:45.983776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ba5259b8-37ba-45a1-9e5f-f8a1e34db884 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.106373 Jul 18 17:01:45.988243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 359/844] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:45 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:46.254555 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cd4232ff-d0b7-4f77-bec8-6a219f3e52d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:46.255594 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cd4232ff-d0b7-4f77-bec8-6a219f3e52d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:46.263221 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cd4232ff-d0b7-4f77-bec8-6a219f3e52d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:46.263712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cd4232ff-d0b7-4f77-bec8-6a219f3e52d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.264556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cd4232ff-d0b7-4f77-bec8-6a219f3e52d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:46.265029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cd4232ff-d0b7-4f77-bec8-6a219f3e52d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.298961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cd4232ff-d0b7-4f77-bec8-6a219f3e52d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049237 Jul 18 17:01:46.299564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 486/845] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:46 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:46.593482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b0f9042d-ad7a-4ca4-9929-f379271c7e85 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:46.594081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b0f9042d-ad7a-4ca4-9929-f379271c7e85 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:46.601981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0f9042d-ad7a-4ca4-9929-f379271c7e85 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:46.602424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0f9042d-ad7a-4ca4-9929-f379271c7e85 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.603523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0f9042d-ad7a-4ca4-9929-f379271c7e85 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:46.603828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0f9042d-ad7a-4ca4-9929-f379271c7e85 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:46.746634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b0f9042d-ad7a-4ca4-9929-f379271c7e85 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:46.755430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b0f9042d-ad7a-4ca4-9929-f379271c7e85 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.165914 Jul 18 17:01:46.756047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 360/846] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:46 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:47.012481 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-51bf3f4f-320c-413d-a30d-9b8d9346297c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:47.013111 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-51bf3f4f-320c-413d-a30d-9b8d9346297c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:47.021141 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-51bf3f4f-320c-413d-a30d-9b8d9346297c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.021581 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-51bf3f4f-320c-413d-a30d-9b8d9346297c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.022350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-51bf3f4f-320c-413d-a30d-9b8d9346297c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.022776 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-51bf3f4f-320c-413d-a30d-9b8d9346297c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.091926 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-51bf3f4f-320c-413d-a30d-9b8d9346297c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:47.100382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-51bf3f4f-320c-413d-a30d-9b8d9346297c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.093115 Jul 18 17:01:47.100956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 487/847] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:47 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:47.310447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-598d967f-0f14-46d5-a931-bfd8ffa8406c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:47.311309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-598d967f-0f14-46d5-a931-bfd8ffa8406c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:47.317415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-598d967f-0f14-46d5-a931-bfd8ffa8406c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.317862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-598d967f-0f14-46d5-a931-bfd8ffa8406c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.318620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-598d967f-0f14-46d5-a931-bfd8ffa8406c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.319057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-598d967f-0f14-46d5-a931-bfd8ffa8406c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.351871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-598d967f-0f14-46d5-a931-bfd8ffa8406c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Jul 18 17:01:47.352433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 361/848] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:47 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:47.772690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-985cc1a6-2074-40a8-bc29-ae4f21611921 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:47.773292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-985cc1a6-2074-40a8-bc29-ae4f21611921 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:47.780030 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-985cc1a6-2074-40a8-bc29-ae4f21611921 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.780478 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-985cc1a6-2074-40a8-bc29-ae4f21611921 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.781257 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-985cc1a6-2074-40a8-bc29-ae4f21611921 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:47.781689 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-985cc1a6-2074-40a8-bc29-ae4f21611921 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:47.937680 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-985cc1a6-2074-40a8-bc29-ae4f21611921 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:47.945791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-985cc1a6-2074-40a8-bc29-ae4f21611921 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.176948 Jul 18 17:01:47.946352 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 488/849] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:47 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:48.117450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-97ab9f43-09d6-4786-9ee9-eaddbd4fa659 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:48.117982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-97ab9f43-09d6-4786-9ee9-eaddbd4fa659 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:48.126843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97ab9f43-09d6-4786-9ee9-eaddbd4fa659 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.127286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97ab9f43-09d6-4786-9ee9-eaddbd4fa659 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.128442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97ab9f43-09d6-4786-9ee9-eaddbd4fa659 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.128879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97ab9f43-09d6-4786-9ee9-eaddbd4fa659 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.133148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:48.197582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-97ab9f43-09d6-4786-9ee9-eaddbd4fa659 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:48.206082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-97ab9f43-09d6-4786-9ee9-eaddbd4fa659 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.092634 Jul 18 17:01:48.206642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 362/850] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:48 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:48.364389 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4270a6a4-c6d9-4540-a490-b03e9de92452 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:48.365312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4270a6a4-c6d9-4540-a490-b03e9de92452 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:48.371923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4270a6a4-c6d9-4540-a490-b03e9de92452 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.372298 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4270a6a4-c6d9-4540-a490-b03e9de92452 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.373118 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4270a6a4-c6d9-4540-a490-b03e9de92452 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.373557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4270a6a4-c6d9-4540-a490-b03e9de92452 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.405740 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4270a6a4-c6d9-4540-a490-b03e9de92452 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045552 Jul 18 17:01:48.406311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 489/851] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:48 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:48.964158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4705dae1-aac3-4200-9455-596f1c5463bc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:48.965489 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4705dae1-aac3-4200-9455-596f1c5463bc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:48.972598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4705dae1-aac3-4200-9455-596f1c5463bc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.973163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4705dae1-aac3-4200-9455-596f1c5463bc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:48.973844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4705dae1-aac3-4200-9455-596f1c5463bc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:48.974363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4705dae1-aac3-4200-9455-596f1c5463bc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:49.115610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4705dae1-aac3-4200-9455-596f1c5463bc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:49.131454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4705dae1-aac3-4200-9455-596f1c5463bc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.171258 Jul 18 17:01:49.132162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 363/852] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:48 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:49.224759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1472caca-edad-4930-865c-848663d47528 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:49.225385 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1472caca-edad-4930-865c-848663d47528 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:49.227318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=77 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:49.233108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1472caca-edad-4930-865c-848663d47528 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:49.233551 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1472caca-edad-4930-865c-848663d47528 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:49.234328 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1472caca-edad-4930-865c-848663d47528 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:49.234757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1472caca-edad-4930-865c-848663d47528 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:49.299379 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1472caca-edad-4930-865c-848663d47528 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:49.306795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1472caca-edad-4930-865c-848663d47528 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085928 Jul 18 17:01:49.307352 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 490/853] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:49 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:49.417944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a1d693b9-a5e3-4d1e-a1b8-3ad99d5d8dc4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:49.418846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a1d693b9-a5e3-4d1e-a1b8-3ad99d5d8dc4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:49.426278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d693b9-a5e3-4d1e-a1b8-3ad99d5d8dc4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:49.426798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d693b9-a5e3-4d1e-a1b8-3ad99d5d8dc4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:49.427699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d693b9-a5e3-4d1e-a1b8-3ad99d5d8dc4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:49.428188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d693b9-a5e3-4d1e-a1b8-3ad99d5d8dc4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:49.462898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a1d693b9-a5e3-4d1e-a1b8-3ad99d5d8dc4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049324 Jul 18 17:01:49.463473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 364/854] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:49 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:50.149250 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c0011883-7bdf-4113-bd35-7542c14e9202 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:50.149842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c0011883-7bdf-4113-bd35-7542c14e9202 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:50.157052 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c0011883-7bdf-4113-bd35-7542c14e9202 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.157496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c0011883-7bdf-4113-bd35-7542c14e9202 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.158252 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c0011883-7bdf-4113-bd35-7542c14e9202 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.158687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c0011883-7bdf-4113-bd35-7542c14e9202 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.301610 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c0011883-7bdf-4113-bd35-7542c14e9202 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:50.309926 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c0011883-7bdf-4113-bd35-7542c14e9202 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.164455 Jul 18 17:01:50.310524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 491/855] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:50 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:50.323172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b072e57e-0707-47ae-8de7-304c14117832 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:50.323796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b072e57e-0707-47ae-8de7-304c14117832 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:50.330910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b072e57e-0707-47ae-8de7-304c14117832 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.331357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b072e57e-0707-47ae-8de7-304c14117832 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.332159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b072e57e-0707-47ae-8de7-304c14117832 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.332594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b072e57e-0707-47ae-8de7-304c14117832 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.395243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b072e57e-0707-47ae-8de7-304c14117832 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:50.404169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b072e57e-0707-47ae-8de7-304c14117832 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084871 Jul 18 17:01:50.404792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 365/856] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:50 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:50.477652 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3fb7f12a-d2b7-48a1-935a-427ebedcb6f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:50.478720 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3fb7f12a-d2b7-48a1-935a-427ebedcb6f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:50.486604 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3fb7f12a-d2b7-48a1-935a-427ebedcb6f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.487388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3fb7f12a-d2b7-48a1-935a-427ebedcb6f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.488335 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3fb7f12a-d2b7-48a1-935a-427ebedcb6f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:50.488850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3fb7f12a-d2b7-48a1-935a-427ebedcb6f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:50.522253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3fb7f12a-d2b7-48a1-935a-427ebedcb6f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049966 Jul 18 17:01:50.522840 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 492/857] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:50 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:51.329733 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-de52dc30-833f-4637-a8a4-fb3948e4d15e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:51.330449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-de52dc30-833f-4637-a8a4-fb3948e4d15e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:51.333499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=75 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:51.339953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de52dc30-833f-4637-a8a4-fb3948e4d15e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.340584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de52dc30-833f-4637-a8a4-fb3948e4d15e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.341572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de52dc30-833f-4637-a8a4-fb3948e4d15e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.342019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de52dc30-833f-4637-a8a4-fb3948e4d15e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.422137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9e6aa854-4e8a-4ab2-98b0-be104b7a557a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:51.423212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9e6aa854-4e8a-4ab2-98b0-be104b7a557a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:51.429545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e6aa854-4e8a-4ab2-98b0-be104b7a557a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.429991 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e6aa854-4e8a-4ab2-98b0-be104b7a557a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.430787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e6aa854-4e8a-4ab2-98b0-be104b7a557a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.431222 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e6aa854-4e8a-4ab2-98b0-be104b7a557a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.481358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-de52dc30-833f-4637-a8a4-fb3948e4d15e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:51.489488 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-de52dc30-833f-4637-a8a4-fb3948e4d15e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.164311 Jul 18 17:01:51.490071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 366/858] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:51 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:51.495130 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9e6aa854-4e8a-4ab2-98b0-be104b7a557a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:51.503372 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9e6aa854-4e8a-4ab2-98b0-be104b7a557a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085962 Jul 18 17:01:51.503960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 493/859] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:51 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:51.534357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8da45559-c488-4431-8d1e-7022dbf07696 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:51.535279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8da45559-c488-4431-8d1e-7022dbf07696 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:51.541455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8da45559-c488-4431-8d1e-7022dbf07696 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.541899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8da45559-c488-4431-8d1e-7022dbf07696 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.543311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8da45559-c488-4431-8d1e-7022dbf07696 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:51.543947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8da45559-c488-4431-8d1e-7022dbf07696 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:51.574104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8da45559-c488-4431-8d1e-7022dbf07696 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Jul 18 17:01:51.574692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 367/860] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:51 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:52.509086 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d54e0a4f-3df0-4356-974f-75d9663dcd42 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:52.509709 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d54e0a4f-3df0-4356-974f-75d9663dcd42 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:52.516473 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d54e0a4f-3df0-4356-974f-75d9663dcd42 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.516921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d54e0a4f-3df0-4356-974f-75d9663dcd42 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.517703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d54e0a4f-3df0-4356-974f-75d9663dcd42 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.518141 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d54e0a4f-3df0-4356-974f-75d9663dcd42 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.520835 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3744dff5-aeb9-4217-a4aa-3301727fb5ab tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:52.521439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3744dff5-aeb9-4217-a4aa-3301727fb5ab tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:52.529133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3744dff5-aeb9-4217-a4aa-3301727fb5ab tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.529581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3744dff5-aeb9-4217-a4aa-3301727fb5ab tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.530369 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3744dff5-aeb9-4217-a4aa-3301727fb5ab tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.530808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3744dff5-aeb9-4217-a4aa-3301727fb5ab tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.595030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3744dff5-aeb9-4217-a4aa-3301727fb5ab tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:52.602646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3744dff5-aeb9-4217-a4aa-3301727fb5ab tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085566 Jul 18 17:01:52.603507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 368/861] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:52 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:52.608287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0a278f4c-52a1-4d87-ac8f-be49a6ab5806 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:52.609229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0a278f4c-52a1-4d87-ac8f-be49a6ab5806 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:52.615439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a278f4c-52a1-4d87-ac8f-be49a6ab5806 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.615905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a278f4c-52a1-4d87-ac8f-be49a6ab5806 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.616667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a278f4c-52a1-4d87-ac8f-be49a6ab5806 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:52.617099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a278f4c-52a1-4d87-ac8f-be49a6ab5806 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:52.650147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0a278f4c-52a1-4d87-ac8f-be49a6ab5806 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045862 Jul 18 17:01:52.650928 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 369/862] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:52 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:52.655803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d54e0a4f-3df0-4356-974f-75d9663dcd42 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:52.664193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d54e0a4f-3df0-4356-974f-75d9663dcd42 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.158894 Jul 18 17:01:52.664779 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 494/863] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:52 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:53.620559 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-64822043-5410-44eb-8454-24942a23d25f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:53.622477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-64822043-5410-44eb-8454-24942a23d25f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:53.629834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64822043-5410-44eb-8454-24942a23d25f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.630290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64822043-5410-44eb-8454-24942a23d25f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.631068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64822043-5410-44eb-8454-24942a23d25f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.631538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64822043-5410-44eb-8454-24942a23d25f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.662150 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-29b45817-13cf-478b-8c8c-bdb1954c745e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:53.663129 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-29b45817-13cf-478b-8c8c-bdb1954c745e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:53.670122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-29b45817-13cf-478b-8c8c-bdb1954c745e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.670567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-29b45817-13cf-478b-8c8c-bdb1954c745e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.671338 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-29b45817-13cf-478b-8c8c-bdb1954c745e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.672049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-29b45817-13cf-478b-8c8c-bdb1954c745e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.696646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-64822043-5410-44eb-8454-24942a23d25f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:53.703703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-29b45817-13cf-478b-8c8c-bdb1954c745e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Jul 18 17:01:53.704272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 495/864] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:53 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:01:53.705322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-64822043-5410-44eb-8454-24942a23d25f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.088998 Jul 18 17:01:53.705964 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 370/865] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:53 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:53.708887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f0f707ac-e091-4978-a58b-3e59987b2bd0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:53.709491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f0f707ac-e091-4978-a58b-3e59987b2bd0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:53.715664 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f0f707ac-e091-4978-a58b-3e59987b2bd0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.716109 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f0f707ac-e091-4978-a58b-3e59987b2bd0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.716867 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f0f707ac-e091-4978-a58b-3e59987b2bd0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:53.717301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f0f707ac-e091-4978-a58b-3e59987b2bd0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:53.857684 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f0f707ac-e091-4978-a58b-3e59987b2bd0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:53.865640 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f0f707ac-e091-4978-a58b-3e59987b2bd0 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.160432 Jul 18 17:01:53.866197 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 496/866] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:53 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:54.715862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-23ed7d47-1d0d-45a6-a23c-73090f7ac897 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:54.716898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-23ed7d47-1d0d-45a6-a23c-73090f7ac897 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:54.722180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cf75342a-af51-4281-bc1f-d1e04b4ba943 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:54.722792 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cf75342a-af51-4281-bc1f-d1e04b4ba943 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:54.723683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-23ed7d47-1d0d-45a6-a23c-73090f7ac897 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.724134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-23ed7d47-1d0d-45a6-a23c-73090f7ac897 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.724902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-23ed7d47-1d0d-45a6-a23c-73090f7ac897 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.725768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-23ed7d47-1d0d-45a6-a23c-73090f7ac897 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.728871 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf75342a-af51-4281-bc1f-d1e04b4ba943 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.729321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf75342a-af51-4281-bc1f-d1e04b4ba943 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.730085 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf75342a-af51-4281-bc1f-d1e04b4ba943 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.730523 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf75342a-af51-4281-bc1f-d1e04b4ba943 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.758225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-23ed7d47-1d0d-45a6-a23c-73090f7ac897 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Jul 18 17:01:54.758841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 371/867] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:54 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:54.796666 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cf75342a-af51-4281-bc1f-d1e04b4ba943 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:54.804800 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cf75342a-af51-4281-bc1f-d1e04b4ba943 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.086646 Jul 18 17:01:54.805382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 497/868] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:54 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:54.882790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-37376e38-cf48-44e6-8575-e3b2e8afd04f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:54.883374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37376e38-cf48-44e6-8575-e3b2e8afd04f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:54.889991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37376e38-cf48-44e6-8575-e3b2e8afd04f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.890433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37376e38-cf48-44e6-8575-e3b2e8afd04f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:54.891184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37376e38-cf48-44e6-8575-e3b2e8afd04f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:54.891639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37376e38-cf48-44e6-8575-e3b2e8afd04f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.034926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37376e38-cf48-44e6-8575-e3b2e8afd04f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:55.042928 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-37376e38-cf48-44e6-8575-e3b2e8afd04f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.164033 Jul 18 17:01:55.043512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 372/869] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:54 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:55.772691 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2e9541e1-97a6-4210-854f-1bc315158e8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:55.773334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2e9541e1-97a6-4210-854f-1bc315158e8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:55.780354 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2e9541e1-97a6-4210-854f-1bc315158e8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.780801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2e9541e1-97a6-4210-854f-1bc315158e8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.781605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2e9541e1-97a6-4210-854f-1bc315158e8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.782041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2e9541e1-97a6-4210-854f-1bc315158e8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.812946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2e9541e1-97a6-4210-854f-1bc315158e8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Jul 18 17:01:55.813505 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 498/870] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:55 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:55.822083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0adc14c1-2f9b-4d30-b1fc-f75a293928f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:55.822711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0adc14c1-2f9b-4d30-b1fc-f75a293928f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:55.830673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0adc14c1-2f9b-4d30-b1fc-f75a293928f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.831113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0adc14c1-2f9b-4d30-b1fc-f75a293928f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.831920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0adc14c1-2f9b-4d30-b1fc-f75a293928f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:55.832598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0adc14c1-2f9b-4d30-b1fc-f75a293928f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:55.905892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0adc14c1-2f9b-4d30-b1fc-f75a293928f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:55.914141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0adc14c1-2f9b-4d30-b1fc-f75a293928f7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.095867 Jul 18 17:01:55.914721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 373/871] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:55 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:56.095318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2ffac6fb-bb79-4eaa-9e5a-9352fa5b89ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:56.095318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2ffac6fb-bb79-4eaa-9e5a-9352fa5b89ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:56.095318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ffac6fb-bb79-4eaa-9e5a-9352fa5b89ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.095318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ffac6fb-bb79-4eaa-9e5a-9352fa5b89ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:56.095833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ffac6fb-bb79-4eaa-9e5a-9352fa5b89ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.095833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ffac6fb-bb79-4eaa-9e5a-9352fa5b89ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:56.221475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2ffac6fb-bb79-4eaa-9e5a-9352fa5b89ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:56.230362 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2ffac6fb-bb79-4eaa-9e5a-9352fa5b89ce tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.171898 Jul 18 17:01:56.230952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 499/872] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:56 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:01:56.824775 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9142ac7f-6af1-40fa-bdf5-f390ea519b12 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:56.826441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9142ac7f-6af1-40fa-bdf5-f390ea519b12 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:56.833125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9142ac7f-6af1-40fa-bdf5-f390ea519b12 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.833576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9142ac7f-6af1-40fa-bdf5-f390ea519b12 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:56.834350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9142ac7f-6af1-40fa-bdf5-f390ea519b12 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.834784 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9142ac7f-6af1-40fa-bdf5-f390ea519b12 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:56.863992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9142ac7f-6af1-40fa-bdf5-f390ea519b12 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 Jul 18 17:01:56.864559 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 374/873] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:56 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:56.931795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-265f07c4-fc6c-43e5-a504-5c18e774ffa6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:56.932396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-265f07c4-fc6c-43e5-a504-5c18e774ffa6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:56.939250 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-265f07c4-fc6c-43e5-a504-5c18e774ffa6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.939743 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-265f07c4-fc6c-43e5-a504-5c18e774ffa6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:56.940491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-265f07c4-fc6c-43e5-a504-5c18e774ffa6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:56.940918 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-265f07c4-fc6c-43e5-a504-5c18e774ffa6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.011751 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-265f07c4-fc6c-43e5-a504-5c18e774ffa6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:57.019731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-265f07c4-fc6c-43e5-a504-5c18e774ffa6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.091682 Jul 18 17:01:57.020297 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 500/874] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:56 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:57.249917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-83237c6b-59b2-4ae9-8bda-850653884204 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:57.250522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-83237c6b-59b2-4ae9-8bda-850653884204 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:57.256590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83237c6b-59b2-4ae9-8bda-850653884204 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.257043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83237c6b-59b2-4ae9-8bda-850653884204 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.257802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83237c6b-59b2-4ae9-8bda-850653884204 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.258241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83237c6b-59b2-4ae9-8bda-850653884204 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.391832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-83237c6b-59b2-4ae9-8bda-850653884204 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:57.400020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-83237c6b-59b2-4ae9-8bda-850653884204 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.154427 Jul 18 17:01:57.400614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 375/875] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:57 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:57.875474 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-92d3939f-75f3-4dd2-90c8-1260c836db40 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:57.876428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-92d3939f-75f3-4dd2-90c8-1260c836db40 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:57.883288 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-92d3939f-75f3-4dd2-90c8-1260c836db40 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.883779 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-92d3939f-75f3-4dd2-90c8-1260c836db40 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.884558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-92d3939f-75f3-4dd2-90c8-1260c836db40 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:57.884994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-92d3939f-75f3-4dd2-90c8-1260c836db40 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:57.912924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:57.918470 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-92d3939f-75f3-4dd2-90c8-1260c836db40 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047329 Jul 18 17:01:57.919734 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 501/876] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:57 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:58.037265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8db6c269-677f-47c0-8218-e2f30705caad tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:58.037892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8db6c269-677f-47c0-8218-e2f30705caad tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:58.045185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8db6c269-677f-47c0-8218-e2f30705caad tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.045634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8db6c269-677f-47c0-8218-e2f30705caad tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.046423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8db6c269-677f-47c0-8218-e2f30705caad tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.047120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8db6c269-677f-47c0-8218-e2f30705caad tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.114873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8db6c269-677f-47c0-8218-e2f30705caad tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:58.122525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8db6c269-677f-47c0-8218-e2f30705caad tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.089154 Jul 18 17:01:58.123151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 376/877] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:58 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:58.418093 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1a6d7bf9-ae0d-4322-98a2-99ddce1fce0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:58.418796 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1a6d7bf9-ae0d-4322-98a2-99ddce1fce0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:58.426475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a6d7bf9-ae0d-4322-98a2-99ddce1fce0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.427086 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a6d7bf9-ae0d-4322-98a2-99ddce1fce0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.427775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a6d7bf9-ae0d-4322-98a2-99ddce1fce0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.428218 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a6d7bf9-ae0d-4322-98a2-99ddce1fce0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.568584 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1a6d7bf9-ae0d-4322-98a2-99ddce1fce0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:58.576646 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1a6d7bf9-ae0d-4322-98a2-99ddce1fce0a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.163016 Jul 18 17:01:58.577209 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 502/878] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:58 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:58.941459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1b35b12a-cd5f-4c10-b976-9b68d9c5bbe5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:58.942380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1b35b12a-cd5f-4c10-b976-9b68d9c5bbe5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:58.948565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b35b12a-cd5f-4c10-b976-9b68d9c5bbe5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.949009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b35b12a-cd5f-4c10-b976-9b68d9c5bbe5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.949772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b35b12a-cd5f-4c10-b976-9b68d9c5bbe5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:58.950344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b35b12a-cd5f-4c10-b976-9b68d9c5bbe5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:58.980790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1b35b12a-cd5f-4c10-b976-9b68d9c5bbe5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 Jul 18 17:01:58.982013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 377/879] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:58 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:01:59.139236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6ca2dfa5-210e-4096-a48d-90ea25a690b6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:59.139791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6ca2dfa5-210e-4096-a48d-90ea25a690b6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:59.146071 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ca2dfa5-210e-4096-a48d-90ea25a690b6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:59.146519 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ca2dfa5-210e-4096-a48d-90ea25a690b6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:59.147282 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ca2dfa5-210e-4096-a48d-90ea25a690b6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:59.147763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6ca2dfa5-210e-4096-a48d-90ea25a690b6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:59.210836 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6ca2dfa5-210e-4096-a48d-90ea25a690b6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:59.221537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6ca2dfa5-210e-4096-a48d-90ea25a690b6 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085913 Jul 18 17:01:59.223765 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 503/880] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:59 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:59.594152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-877bc43e-28ee-4af1-a5e9-846aa0359448 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:59.594763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-877bc43e-28ee-4af1-a5e9-846aa0359448 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:01:59.601378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-877bc43e-28ee-4af1-a5e9-846aa0359448 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:59.601830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-877bc43e-28ee-4af1-a5e9-846aa0359448 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:59.602593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-877bc43e-28ee-4af1-a5e9-846aa0359448 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:01:59.603033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-877bc43e-28ee-4af1-a5e9-846aa0359448 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:01:59.746473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-877bc43e-28ee-4af1-a5e9-846aa0359448 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:01:59.750596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:59.755684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-877bc43e-28ee-4af1-a5e9-846aa0359448 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.165243 Jul 18 17:01:59.756184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 378/881] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:01:59 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:01:59.993636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a014ad58-4c37-4d2d-82ad-a0edb5a05b80 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:01:59.994471 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a014ad58-4c37-4d2d-82ad-a0edb5a05b80 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:00.001961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a014ad58-4c37-4d2d-82ad-a0edb5a05b80 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.002396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a014ad58-4c37-4d2d-82ad-a0edb5a05b80 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.003159 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a014ad58-4c37-4d2d-82ad-a0edb5a05b80 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.003630 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a014ad58-4c37-4d2d-82ad-a0edb5a05b80 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.032542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a014ad58-4c37-4d2d-82ad-a0edb5a05b80 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043141 Jul 18 17:02:00.033094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 504/882] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:01:59 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:00.239051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5d0bf6be-dcad-4764-b224-c39f48877551 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:00.239689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5d0bf6be-dcad-4764-b224-c39f48877551 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:00.246841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d0bf6be-dcad-4764-b224-c39f48877551 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.248343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d0bf6be-dcad-4764-b224-c39f48877551 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.249135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d0bf6be-dcad-4764-b224-c39f48877551 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.249588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d0bf6be-dcad-4764-b224-c39f48877551 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.313838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5d0bf6be-dcad-4764-b224-c39f48877551 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:00.321676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5d0bf6be-dcad-4764-b224-c39f48877551 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.086770 Jul 18 17:02:00.324602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 379/883] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:00 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:00.773278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-434decda-95a4-422d-a8db-a3b541ae2974 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:00.773883 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-434decda-95a4-422d-a8db-a3b541ae2974 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:00.780753 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-434decda-95a4-422d-a8db-a3b541ae2974 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.781201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-434decda-95a4-422d-a8db-a3b541ae2974 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.782124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-434decda-95a4-422d-a8db-a3b541ae2974 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:00.782567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-434decda-95a4-422d-a8db-a3b541ae2974 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:00.917443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-434decda-95a4-422d-a8db-a3b541ae2974 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:00.925726 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-434decda-95a4-422d-a8db-a3b541ae2974 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.156216 Jul 18 17:02:00.926290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 505/884] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:00 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:01.044601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-11e4eafc-1680-4697-89ca-b459797645fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:01.045439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-11e4eafc-1680-4697-89ca-b459797645fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:01.052311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11e4eafc-1680-4697-89ca-b459797645fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.052754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11e4eafc-1680-4697-89ca-b459797645fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:01.053508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11e4eafc-1680-4697-89ca-b459797645fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.053942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11e4eafc-1680-4697-89ca-b459797645fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:01.083913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-11e4eafc-1680-4697-89ca-b459797645fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Jul 18 17:02:01.084393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 380/885] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:01 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:01.338146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-99dbea0e-4dcb-4bcb-ae03-ae916176d4a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:01.338703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-99dbea0e-4dcb-4bcb-ae03-ae916176d4a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:01.344889 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99dbea0e-4dcb-4bcb-ae03-ae916176d4a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.345334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99dbea0e-4dcb-4bcb-ae03-ae916176d4a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:01.346091 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99dbea0e-4dcb-4bcb-ae03-ae916176d4a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.346520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99dbea0e-4dcb-4bcb-ae03-ae916176d4a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:01.410196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-99dbea0e-4dcb-4bcb-ae03-ae916176d4a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:01.417889 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-99dbea0e-4dcb-4bcb-ae03-ae916176d4a0 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.083745 Jul 18 17:02:01.418470 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 506/886] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:01 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:01.942882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-da71afe1-c352-49d2-a780-c23761c77afb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:01.943529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-da71afe1-c352-49d2-a780-c23761c77afb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:01.950539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da71afe1-c352-49d2-a780-c23761c77afb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.951154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da71afe1-c352-49d2-a780-c23761c77afb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:01.951984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da71afe1-c352-49d2-a780-c23761c77afb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:01.952425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da71afe1-c352-49d2-a780-c23761c77afb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:02.083149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-da71afe1-c352-49d2-a780-c23761c77afb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:02.092242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-da71afe1-c352-49d2-a780-c23761c77afb tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.153426 Jul 18 17:02:02.092978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 381/887] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:01 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:02.096093 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4a2627ba-f96a-4746-895d-31b3069dd421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:02.097083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4a2627ba-f96a-4746-895d-31b3069dd421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:02.104176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a2627ba-f96a-4746-895d-31b3069dd421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:02.104627 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a2627ba-f96a-4746-895d-31b3069dd421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:02.105385 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a2627ba-f96a-4746-895d-31b3069dd421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:02.105817 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a2627ba-f96a-4746-895d-31b3069dd421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:02.135332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4a2627ba-f96a-4746-895d-31b3069dd421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Jul 18 17:02:02.135908 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 507/888] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:02 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:02.434400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-88bb44ef-daf1-4b29-b678-0f55f51a3c36 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:02.434924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-88bb44ef-daf1-4b29-b678-0f55f51a3c36 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:02.441217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88bb44ef-daf1-4b29-b678-0f55f51a3c36 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:02.441687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88bb44ef-daf1-4b29-b678-0f55f51a3c36 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:02.442465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88bb44ef-daf1-4b29-b678-0f55f51a3c36 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:02.442899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88bb44ef-daf1-4b29-b678-0f55f51a3c36 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:02.506530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-88bb44ef-daf1-4b29-b678-0f55f51a3c36 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:02.515406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-88bb44ef-daf1-4b29-b678-0f55f51a3c36 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084918 Jul 18 17:02:02.516032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 382/889] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:02 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:03.109866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8f9dbf48-740b-4f60-9501-abd47d36b0ad tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:03.110392 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8f9dbf48-740b-4f60-9501-abd47d36b0ad tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:03.116451 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8f9dbf48-740b-4f60-9501-abd47d36b0ad tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:03.116903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8f9dbf48-740b-4f60-9501-abd47d36b0ad tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:03.117658 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8f9dbf48-740b-4f60-9501-abd47d36b0ad tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:03.118093 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8f9dbf48-740b-4f60-9501-abd47d36b0ad tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:03.147477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-444db8ed-26d3-4423-8aed-1361d0db1ab1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:03.148416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-444db8ed-26d3-4423-8aed-1361d0db1ab1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:03.156485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-444db8ed-26d3-4423-8aed-1361d0db1ab1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:03.156485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-444db8ed-26d3-4423-8aed-1361d0db1ab1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:03.156764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-444db8ed-26d3-4423-8aed-1361d0db1ab1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:03.157078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-444db8ed-26d3-4423-8aed-1361d0db1ab1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:03.190842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-444db8ed-26d3-4423-8aed-1361d0db1ab1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047328 Jul 18 17:02:03.191414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 383/890] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:03 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:03.257024 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8f9dbf48-740b-4f60-9501-abd47d36b0ad tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:03.264994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8f9dbf48-740b-4f60-9501-abd47d36b0ad tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.159649 Jul 18 17:02:03.265564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 508/891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:03 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:03.532705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a212179c-5246-4b05-8999-08cf39d6f701 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:03.533313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a212179c-5246-4b05-8999-08cf39d6f701 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:03.539360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a212179c-5246-4b05-8999-08cf39d6f701 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:03.539857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a212179c-5246-4b05-8999-08cf39d6f701 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:03.540668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a212179c-5246-4b05-8999-08cf39d6f701 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:03.541152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a212179c-5246-4b05-8999-08cf39d6f701 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:03.611344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a212179c-5246-4b05-8999-08cf39d6f701 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:03.619869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a212179c-5246-4b05-8999-08cf39d6f701 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.091416 Jul 18 17:02:03.620449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 384/892] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:03 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:04.203464 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1fb6a856-10bc-43d5-abc1-fefcd7c1c67e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:04.204410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1fb6a856-10bc-43d5-abc1-fefcd7c1c67e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:04.210694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fb6a856-10bc-43d5-abc1-fefcd7c1c67e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.211140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fb6a856-10bc-43d5-abc1-fefcd7c1c67e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.212082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fb6a856-10bc-43d5-abc1-fefcd7c1c67e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.212630 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fb6a856-10bc-43d5-abc1-fefcd7c1c67e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.247763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1fb6a856-10bc-43d5-abc1-fefcd7c1c67e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048628 Jul 18 17:02:04.247763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 509/893] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:04 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:04.282535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d7a84d76-2cc0-4c2c-bfba-0e38d4af33ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:04.283206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d7a84d76-2cc0-4c2c-bfba-0e38d4af33ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:04.289693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7a84d76-2cc0-4c2c-bfba-0e38d4af33ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.290144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7a84d76-2cc0-4c2c-bfba-0e38d4af33ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.290910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7a84d76-2cc0-4c2c-bfba-0e38d4af33ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.291348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7a84d76-2cc0-4c2c-bfba-0e38d4af33ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.491520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d7a84d76-2cc0-4c2c-bfba-0e38d4af33ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:04.500920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d7a84d76-2cc0-4c2c-bfba-0e38d4af33ac tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.222259 Jul 18 17:02:04.501503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 385/894] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:04 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:04.637035 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6f55cf3f-366b-475f-ade1-86ff79805462 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:04.637596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6f55cf3f-366b-475f-ade1-86ff79805462 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:04.643848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6f55cf3f-366b-475f-ade1-86ff79805462 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.644303 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6f55cf3f-366b-475f-ade1-86ff79805462 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.645057 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6f55cf3f-366b-475f-ade1-86ff79805462 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:04.645493 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6f55cf3f-366b-475f-ade1-86ff79805462 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:04.707402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6f55cf3f-366b-475f-ade1-86ff79805462 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:04.714952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6f55cf3f-366b-475f-ade1-86ff79805462 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.081998 Jul 18 17:02:04.715675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 510/895] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:04 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:05.258501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-23f92a83-03ad-428f-b703-a7a882e1e596 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:05.259417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-23f92a83-03ad-428f-b703-a7a882e1e596 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:05.266209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-23f92a83-03ad-428f-b703-a7a882e1e596 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.266650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-23f92a83-03ad-428f-b703-a7a882e1e596 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.267402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-23f92a83-03ad-428f-b703-a7a882e1e596 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.267860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-23f92a83-03ad-428f-b703-a7a882e1e596 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.300624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-23f92a83-03ad-428f-b703-a7a882e1e596 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 Jul 18 17:02:05.301359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 386/896] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:05 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:05.518260 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f352e2ed-1105-43de-b7bf-0c309ecbe753 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:05.518822 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f352e2ed-1105-43de-b7bf-0c309ecbe753 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:05.524756 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f352e2ed-1105-43de-b7bf-0c309ecbe753 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.526395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f352e2ed-1105-43de-b7bf-0c309ecbe753 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.526395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f352e2ed-1105-43de-b7bf-0c309ecbe753 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.526395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f352e2ed-1105-43de-b7bf-0c309ecbe753 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.658297 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f352e2ed-1105-43de-b7bf-0c309ecbe753 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:05.665004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f352e2ed-1105-43de-b7bf-0c309ecbe753 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.150540 Jul 18 17:02:05.665582 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 511/897] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:05 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:05.780114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1a1d5f51-4b63-4f85-a516-0b23413e6def tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:05.780723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1a1d5f51-4b63-4f85-a516-0b23413e6def tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:05.786910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a1d5f51-4b63-4f85-a516-0b23413e6def tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.787459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a1d5f51-4b63-4f85-a516-0b23413e6def tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.788149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a1d5f51-4b63-4f85-a516-0b23413e6def tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:05.788582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a1d5f51-4b63-4f85-a516-0b23413e6def tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:05.853004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1a1d5f51-4b63-4f85-a516-0b23413e6def tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:05.860811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1a1d5f51-4b63-4f85-a516-0b23413e6def tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.132359 Jul 18 17:02:05.861367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 387/898] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:05 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:06.315527 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-92bfc04e-a9bd-48fa-aba8-daa41c7008fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:06.316438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-92bfc04e-a9bd-48fa-aba8-daa41c7008fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:06.322614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-92bfc04e-a9bd-48fa-aba8-daa41c7008fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.323065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-92bfc04e-a9bd-48fa-aba8-daa41c7008fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.323851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-92bfc04e-a9bd-48fa-aba8-daa41c7008fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.324292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-92bfc04e-a9bd-48fa-aba8-daa41c7008fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.353588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-92bfc04e-a9bd-48fa-aba8-daa41c7008fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 Jul 18 17:02:06.354136 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 512/899] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:06 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:06.683565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b7c48472-1b48-4b5f-99ce-cd6fabea504c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:06.684112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b7c48472-1b48-4b5f-99ce-cd6fabea504c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:06.691842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b7c48472-1b48-4b5f-99ce-cd6fabea504c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.692289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b7c48472-1b48-4b5f-99ce-cd6fabea504c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.693501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b7c48472-1b48-4b5f-99ce-cd6fabea504c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.693501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b7c48472-1b48-4b5f-99ce-cd6fabea504c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.825035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b7c48472-1b48-4b5f-99ce-cd6fabea504c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:06.833244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b7c48472-1b48-4b5f-99ce-cd6fabea504c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.153561 Jul 18 17:02:06.833811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 388/900] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:06 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:06.878297 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-55d2c799-652d-45b1-9ced-bc6d2bf469aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:06.878902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-55d2c799-652d-45b1-9ced-bc6d2bf469aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:06.884914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55d2c799-652d-45b1-9ced-bc6d2bf469aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.885361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55d2c799-652d-45b1-9ced-bc6d2bf469aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.886119 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55d2c799-652d-45b1-9ced-bc6d2bf469aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:06.886554 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55d2c799-652d-45b1-9ced-bc6d2bf469aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:06.947832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-55d2c799-652d-45b1-9ced-bc6d2bf469aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:06.955578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-55d2c799-652d-45b1-9ced-bc6d2bf469aa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.081193 Jul 18 17:02:06.956179 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 513/901] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:06 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:07.365794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b8fa2944-e66f-4821-874c-9f4b96a0fb79 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:07.366791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b8fa2944-e66f-4821-874c-9f4b96a0fb79 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:07.373031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8fa2944-e66f-4821-874c-9f4b96a0fb79 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.373484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8fa2944-e66f-4821-874c-9f4b96a0fb79 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.374250 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8fa2944-e66f-4821-874c-9f4b96a0fb79 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.374691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8fa2944-e66f-4821-874c-9f4b96a0fb79 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.404683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b8fa2944-e66f-4821-874c-9f4b96a0fb79 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 Jul 18 17:02:07.405241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 389/902] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:07 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:07.850263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5e5c48c8-e164-47c2-8c51-402a4dc2a8d1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:07.850893 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5e5c48c8-e164-47c2-8c51-402a4dc2a8d1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:07.857352 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5e5c48c8-e164-47c2-8c51-402a4dc2a8d1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.857809 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5e5c48c8-e164-47c2-8c51-402a4dc2a8d1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.858583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5e5c48c8-e164-47c2-8c51-402a4dc2a8d1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.859016 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5e5c48c8-e164-47c2-8c51-402a4dc2a8d1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.973460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3f4ed12b-3322-4d2f-9aad-ff7fdce42a8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:07.974363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3f4ed12b-3322-4d2f-9aad-ff7fdce42a8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:07.982892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f4ed12b-3322-4d2f-9aad-ff7fdce42a8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.983522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f4ed12b-3322-4d2f-9aad-ff7fdce42a8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:07.984179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f4ed12b-3322-4d2f-9aad-ff7fdce42a8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:07.984615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f4ed12b-3322-4d2f-9aad-ff7fdce42a8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:08.056300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3f4ed12b-3322-4d2f-9aad-ff7fdce42a8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:08.064460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3f4ed12b-3322-4d2f-9aad-ff7fdce42a8b tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.095476 Jul 18 17:02:08.065049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 390/903] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:08.223407 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5e5c48c8-e164-47c2-8c51-402a4dc2a8d1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:08.232402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5e5c48c8-e164-47c2-8c51-402a4dc2a8d1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.385647 Jul 18 17:02:08.233018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 514/904] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:07 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:08.416619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9ac43efc-8736-4b97-8d51-c719ab49dc25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:08.417514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9ac43efc-8736-4b97-8d51-c719ab49dc25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:08.424092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac43efc-8736-4b97-8d51-c719ab49dc25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:08.424544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac43efc-8736-4b97-8d51-c719ab49dc25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:08.425316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac43efc-8736-4b97-8d51-c719ab49dc25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:08.425756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac43efc-8736-4b97-8d51-c719ab49dc25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:08.456963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9ac43efc-8736-4b97-8d51-c719ab49dc25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Jul 18 17:02:08.457534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 391/905] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:08 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:09.081478 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-021110b5-9edc-4721-ac6c-57348eaecb1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:09.082089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-021110b5-9edc-4721-ac6c-57348eaecb1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:09.088283 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-021110b5-9edc-4721-ac6c-57348eaecb1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.088698 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-021110b5-9edc-4721-ac6c-57348eaecb1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.089515 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-021110b5-9edc-4721-ac6c-57348eaecb1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.089955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-021110b5-9edc-4721-ac6c-57348eaecb1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.151398 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-021110b5-9edc-4721-ac6c-57348eaecb1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:09.159642 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-021110b5-9edc-4721-ac6c-57348eaecb1f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.081972 Jul 18 17:02:09.160206 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 515/906] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:09 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:09.259174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b29bcca0-b498-477f-a3ca-b817d0744d4e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:09.259970 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b29bcca0-b498-477f-a3ca-b817d0744d4e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:09.266711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b29bcca0-b498-477f-a3ca-b817d0744d4e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.267165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b29bcca0-b498-477f-a3ca-b817d0744d4e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.267967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b29bcca0-b498-477f-a3ca-b817d0744d4e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.268390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b29bcca0-b498-477f-a3ca-b817d0744d4e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.415665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b29bcca0-b498-477f-a3ca-b817d0744d4e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:09.424931 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b29bcca0-b498-477f-a3ca-b817d0744d4e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.169771 Jul 18 17:02:09.425511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 392/907] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:09 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:09.469930 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b566b971-c224-41f4-b1ba-6e01f669d0fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:09.470856 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b566b971-c224-41f4-b1ba-6e01f669d0fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:09.477359 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b566b971-c224-41f4-b1ba-6e01f669d0fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.477803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b566b971-c224-41f4-b1ba-6e01f669d0fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.478557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b566b971-c224-41f4-b1ba-6e01f669d0fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:09.478991 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b566b971-c224-41f4-b1ba-6e01f669d0fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:09.511576 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b566b971-c224-41f4-b1ba-6e01f669d0fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046823 Jul 18 17:02:09.512150 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 516/908] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:09 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:10.177502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-005d17c6-fdc2-43b1-8f4b-585e614e96bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.178023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-005d17c6-fdc2-43b1-8f4b-585e614e96bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:10.184288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-005d17c6-fdc2-43b1-8f4b-585e614e96bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.184766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-005d17c6-fdc2-43b1-8f4b-585e614e96bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.185543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-005d17c6-fdc2-43b1-8f4b-585e614e96bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.186000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-005d17c6-fdc2-43b1-8f4b-585e614e96bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.249029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-005d17c6-fdc2-43b1-8f4b-585e614e96bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:10.256751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-005d17c6-fdc2-43b1-8f4b-585e614e96bb tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.083321 Jul 18 17:02:10.257572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 393/909] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:10 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:10.442447 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0d047d2a-5d98-4850-b339-ff8888514a02 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.442969 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0d047d2a-5d98-4850-b339-ff8888514a02 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:10.449005 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0d047d2a-5d98-4850-b339-ff8888514a02 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.449448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0d047d2a-5d98-4850-b339-ff8888514a02 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.450203 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0d047d2a-5d98-4850-b339-ff8888514a02 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.450834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0d047d2a-5d98-4850-b339-ff8888514a02 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.524808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5dd929e7-39ab-4353-b9d7-3f403a30d9bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:10.525887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5dd929e7-39ab-4353-b9d7-3f403a30d9bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:10.534043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dd929e7-39ab-4353-b9d7-3f403a30d9bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.534514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dd929e7-39ab-4353-b9d7-3f403a30d9bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.535315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dd929e7-39ab-4353-b9d7-3f403a30d9bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:10.535776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dd929e7-39ab-4353-b9d7-3f403a30d9bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:10.568011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5dd929e7-39ab-4353-b9d7-3f403a30d9bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049466 Jul 18 17:02:10.568577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 394/910] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:10 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:10.585166 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0d047d2a-5d98-4850-b339-ff8888514a02 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:10.593470 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0d047d2a-5d98-4850-b339-ff8888514a02 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.154930 Jul 18 17:02:10.594045 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 517/911] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:10 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:11.274197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bdf57d86-2643-4a68-af0e-baeeae8dcf10 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:11.274801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bdf57d86-2643-4a68-af0e-baeeae8dcf10 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:11.281614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bdf57d86-2643-4a68-af0e-baeeae8dcf10 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.282063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bdf57d86-2643-4a68-af0e-baeeae8dcf10 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.282839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bdf57d86-2643-4a68-af0e-baeeae8dcf10 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.283282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bdf57d86-2643-4a68-af0e-baeeae8dcf10 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.303468 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:11.349038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bdf57d86-2643-4a68-af0e-baeeae8dcf10 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:11.358008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bdf57d86-2643-4a68-af0e-baeeae8dcf10 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.087187 Jul 18 17:02:11.358630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 395/912] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:11 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:11.579955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6af856aa-06c9-4ace-aec2-b6875c1e1eca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:11.580791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6af856aa-06c9-4ace-aec2-b6875c1e1eca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:11.587673 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6af856aa-06c9-4ace-aec2-b6875c1e1eca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.588318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6af856aa-06c9-4ace-aec2-b6875c1e1eca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.588858 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6af856aa-06c9-4ace-aec2-b6875c1e1eca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.589311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6af856aa-06c9-4ace-aec2-b6875c1e1eca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.609542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:11.610741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9c33dea6-fcc2-4219-b686-2dc345b6f41e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:11.611246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9c33dea6-fcc2-4219-b686-2dc345b6f41e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:11.618248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c33dea6-fcc2-4219-b686-2dc345b6f41e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.626713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c33dea6-fcc2-4219-b686-2dc345b6f41e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.626713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c33dea6-fcc2-4219-b686-2dc345b6f41e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:11.626713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c33dea6-fcc2-4219-b686-2dc345b6f41e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:11.627035 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6af856aa-06c9-4ace-aec2-b6875c1e1eca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049530 Jul 18 17:02:11.627035 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 518/913] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:11 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:11.758908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9c33dea6-fcc2-4219-b686-2dc345b6f41e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:11.768002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9c33dea6-fcc2-4219-b686-2dc345b6f41e tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.161312 Jul 18 17:02:11.768602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 396/914] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:11 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:12.375093 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a9d340d9-013c-4e48-a76f-6e1eb98c4585 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:12.375732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a9d340d9-013c-4e48-a76f-6e1eb98c4585 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:12.382537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a9d340d9-013c-4e48-a76f-6e1eb98c4585 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.382982 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a9d340d9-013c-4e48-a76f-6e1eb98c4585 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:12.383790 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a9d340d9-013c-4e48-a76f-6e1eb98c4585 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.384226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a9d340d9-013c-4e48-a76f-6e1eb98c4585 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:12.455952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a9d340d9-013c-4e48-a76f-6e1eb98c4585 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:12.464106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a9d340d9-013c-4e48-a76f-6e1eb98c4585 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.092833 Jul 18 17:02:12.464825 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 519/915] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:12 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:12.637431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c1ae400d-094c-4043-8610-5309e7891506 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:12.639676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c1ae400d-094c-4043-8610-5309e7891506 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:12.646420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1ae400d-094c-4043-8610-5309e7891506 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.646860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1ae400d-094c-4043-8610-5309e7891506 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:12.647662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1ae400d-094c-4043-8610-5309e7891506 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.648094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1ae400d-094c-4043-8610-5309e7891506 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:12.681396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c1ae400d-094c-4043-8610-5309e7891506 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047969 Jul 18 17:02:12.681981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 397/916] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:12 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:12.786712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0a1053d2-2289-4394-b57e-fe3befab8a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:12.787858 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0a1053d2-2289-4394-b57e-fe3befab8a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:12.796728 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0a1053d2-2289-4394-b57e-fe3befab8a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.797767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0a1053d2-2289-4394-b57e-fe3befab8a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:12.799112 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0a1053d2-2289-4394-b57e-fe3befab8a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:12.799904 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0a1053d2-2289-4394-b57e-fe3befab8a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:12.939734 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0a1053d2-2289-4394-b57e-fe3befab8a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:12.947992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0a1053d2-2289-4394-b57e-fe3befab8a3a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.166762 Jul 18 17:02:12.948556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 520/917] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:12 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:13.481978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1f17b327-0384-4057-b45c-e5ee3847d688 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:13.482583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1f17b327-0384-4057-b45c-e5ee3847d688 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:13.488856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1f17b327-0384-4057-b45c-e5ee3847d688 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.489299 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1f17b327-0384-4057-b45c-e5ee3847d688 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.490093 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1f17b327-0384-4057-b45c-e5ee3847d688 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.490520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1f17b327-0384-4057-b45c-e5ee3847d688 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.555605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1f17b327-0384-4057-b45c-e5ee3847d688 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:13.564135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1f17b327-0384-4057-b45c-e5ee3847d688 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085823 Jul 18 17:02:13.564720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 398/918] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:13 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:13.692884 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b1b41a74-c30b-4bf0-9b17-4f436e764519 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:13.693827 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b1b41a74-c30b-4bf0-9b17-4f436e764519 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:13.700226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b1b41a74-c30b-4bf0-9b17-4f436e764519 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.701903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b1b41a74-c30b-4bf0-9b17-4f436e764519 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.702036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b1b41a74-c30b-4bf0-9b17-4f436e764519 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.702448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b1b41a74-c30b-4bf0-9b17-4f436e764519 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.735173 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b1b41a74-c30b-4bf0-9b17-4f436e764519 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046133 Jul 18 17:02:13.735708 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 521/919] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:13 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:13.965161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b79b3b6d-0575-43a9-9c16-290be3ab6243 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:13.965831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b79b3b6d-0575-43a9-9c16-290be3ab6243 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:13.974144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b79b3b6d-0575-43a9-9c16-290be3ab6243 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.974590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b79b3b6d-0575-43a9-9c16-290be3ab6243 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:13.975353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b79b3b6d-0575-43a9-9c16-290be3ab6243 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:13.975824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b79b3b6d-0575-43a9-9c16-290be3ab6243 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.133923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b79b3b6d-0575-43a9-9c16-290be3ab6243 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:14.142914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b79b3b6d-0575-43a9-9c16-290be3ab6243 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.181599 Jul 18 17:02:14.143525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 399/920] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:13 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:14.581526 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bc556fcc-ea20-4637-a87d-2843db925d40 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:14.582150 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bc556fcc-ea20-4637-a87d-2843db925d40 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:14.588436 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bc556fcc-ea20-4637-a87d-2843db925d40 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:14.588882 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bc556fcc-ea20-4637-a87d-2843db925d40 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.589647 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bc556fcc-ea20-4637-a87d-2843db925d40 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:14.590108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bc556fcc-ea20-4637-a87d-2843db925d40 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.672512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bc556fcc-ea20-4637-a87d-2843db925d40 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:14.680347 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bc556fcc-ea20-4637-a87d-2843db925d40 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.102955 Jul 18 17:02:14.680964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 522/921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:14 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:14.746798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bd3a88d1-26c0-4849-a764-bb5c784506a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:14.747814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bd3a88d1-26c0-4849-a764-bb5c784506a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:14.754521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd3a88d1-26c0-4849-a764-bb5c784506a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:14.754966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd3a88d1-26c0-4849-a764-bb5c784506a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.755954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd3a88d1-26c0-4849-a764-bb5c784506a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:14.756399 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd3a88d1-26c0-4849-a764-bb5c784506a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:14.789314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bd3a88d1-26c0-4849-a764-bb5c784506a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046604 Jul 18 17:02:14.789841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 400/922] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:14 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:15.160979 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8221db64-341e-4d2c-95f8-fa649fa164e5 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:15.161658 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8221db64-341e-4d2c-95f8-fa649fa164e5 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:15.171942 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8221db64-341e-4d2c-95f8-fa649fa164e5 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.172645 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8221db64-341e-4d2c-95f8-fa649fa164e5 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.173440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8221db64-341e-4d2c-95f8-fa649fa164e5 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.173856 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8221db64-341e-4d2c-95f8-fa649fa164e5 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.313672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8221db64-341e-4d2c-95f8-fa649fa164e5 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:15.321591 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8221db64-341e-4d2c-95f8-fa649fa164e5 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.164641 Jul 18 17:02:15.322162 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 523/923] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:15 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:15.697419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e630c1e9-20ce-4c71-9da4-1585e385c930 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:15.698023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e630c1e9-20ce-4c71-9da4-1585e385c930 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:15.705433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e630c1e9-20ce-4c71-9da4-1585e385c930 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.705882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e630c1e9-20ce-4c71-9da4-1585e385c930 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.706668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e630c1e9-20ce-4c71-9da4-1585e385c930 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.707106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e630c1e9-20ce-4c71-9da4-1585e385c930 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.772867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e630c1e9-20ce-4c71-9da4-1585e385c930 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:15.780643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e630c1e9-20ce-4c71-9da4-1585e385c930 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.087105 Jul 18 17:02:15.781524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 401/924] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:15 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:15.802180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8b8b7d2b-57ba-4591-a44e-9ed08f236583 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:15.803104 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8b8b7d2b-57ba-4591-a44e-9ed08f236583 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:15.809263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b8b7d2b-57ba-4591-a44e-9ed08f236583 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.811096 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b8b7d2b-57ba-4591-a44e-9ed08f236583 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.811402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b8b7d2b-57ba-4591-a44e-9ed08f236583 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:15.811889 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b8b7d2b-57ba-4591-a44e-9ed08f236583 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:15.846538 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8b8b7d2b-57ba-4591-a44e-9ed08f236583 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048205 Jul 18 17:02:15.847123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 524/925] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:15 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:16.339061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7fd16d9d-f69c-493f-8670-dcb595b30203 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:16.339678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7fd16d9d-f69c-493f-8670-dcb595b30203 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:16.348133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7fd16d9d-f69c-493f-8670-dcb595b30203 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:16.348573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7fd16d9d-f69c-493f-8670-dcb595b30203 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:16.349336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7fd16d9d-f69c-493f-8670-dcb595b30203 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:16.349763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7fd16d9d-f69c-493f-8670-dcb595b30203 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:16.488791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7fd16d9d-f69c-493f-8670-dcb595b30203 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:16.496788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7fd16d9d-f69c-493f-8670-dcb595b30203 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.161580 Jul 18 17:02:16.497417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 402/926] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:16 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:16.797929 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-afb2ebe6-296d-4746-b428-761b1a37120f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:16.798522 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-afb2ebe6-296d-4746-b428-761b1a37120f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:16.804446 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-afb2ebe6-296d-4746-b428-761b1a37120f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:16.805017 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-afb2ebe6-296d-4746-b428-761b1a37120f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:16.805605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-afb2ebe6-296d-4746-b428-761b1a37120f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:16.806033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-afb2ebe6-296d-4746-b428-761b1a37120f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:16.857798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a1b162e4-a228-4569-8dd2-507b3ed8f9ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:16.858727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a1b162e4-a228-4569-8dd2-507b3ed8f9ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:16.865717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1b162e4-a228-4569-8dd2-507b3ed8f9ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:16.866165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1b162e4-a228-4569-8dd2-507b3ed8f9ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:16.866949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1b162e4-a228-4569-8dd2-507b3ed8f9ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:16.867388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1b162e4-a228-4569-8dd2-507b3ed8f9ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:16.868812 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-afb2ebe6-296d-4746-b428-761b1a37120f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:16.878591 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-afb2ebe6-296d-4746-b428-761b1a37120f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084836 Jul 18 17:02:16.879161 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 525/927] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:16 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:16.904907 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a1b162e4-a228-4569-8dd2-507b3ed8f9ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051169 Jul 18 17:02:16.905486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 403/928] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:16 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:17.514908 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6eb77529-a861-4f3d-a997-13de5118dd06 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:17.515545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6eb77529-a861-4f3d-a997-13de5118dd06 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:17.522151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6eb77529-a861-4f3d-a997-13de5118dd06 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.522605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6eb77529-a861-4f3d-a997-13de5118dd06 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.523384 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6eb77529-a861-4f3d-a997-13de5118dd06 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.523851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6eb77529-a861-4f3d-a997-13de5118dd06 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.663310 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6eb77529-a861-4f3d-a997-13de5118dd06 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:17.671546 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6eb77529-a861-4f3d-a997-13de5118dd06 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.161003 Jul 18 17:02:17.672107 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 526/929] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:17 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:17.895439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f2b82d69-9936-4071-9f15-129cd9b616f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:17.896085 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f2b82d69-9936-4071-9f15-129cd9b616f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:17.902605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2b82d69-9936-4071-9f15-129cd9b616f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.903054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2b82d69-9936-4071-9f15-129cd9b616f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.904072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2b82d69-9936-4071-9f15-129cd9b616f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.904520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2b82d69-9936-4071-9f15-129cd9b616f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.916773 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7943a285-3061-4b61-a4a4-1dd9ae6bdd69 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:17.917702 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7943a285-3061-4b61-a4a4-1dd9ae6bdd69 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:17.924732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7943a285-3061-4b61-a4a4-1dd9ae6bdd69 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.925178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7943a285-3061-4b61-a4a4-1dd9ae6bdd69 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.925950 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7943a285-3061-4b61-a4a4-1dd9ae6bdd69 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:17.926396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7943a285-3061-4b61-a4a4-1dd9ae6bdd69 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:17.957497 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7943a285-3061-4b61-a4a4-1dd9ae6bdd69 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Jul 18 17:02:17.958064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 527/930] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:17 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:17.969904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f2b82d69-9936-4071-9f15-129cd9b616f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:17.977403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f2b82d69-9936-4071-9f15-129cd9b616f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085864 Jul 18 17:02:17.977956 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 404/931] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:17 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:18.688942 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e86f7824-0415-44e6-921d-0dbb7d40790f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:18.689545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e86f7824-0415-44e6-921d-0dbb7d40790f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:18.695842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e86f7824-0415-44e6-921d-0dbb7d40790f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.696284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e86f7824-0415-44e6-921d-0dbb7d40790f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.697048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e86f7824-0415-44e6-921d-0dbb7d40790f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.697480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e86f7824-0415-44e6-921d-0dbb7d40790f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.831322 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e86f7824-0415-44e6-921d-0dbb7d40790f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:18.839596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e86f7824-0415-44e6-921d-0dbb7d40790f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.154459 Jul 18 17:02:18.840158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 528/932] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:18 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:18.970208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f7c5cdf7-a097-4868-815f-bc02339ad722 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:18.971040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f7c5cdf7-a097-4868-815f-bc02339ad722 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:18.977761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7c5cdf7-a097-4868-815f-bc02339ad722 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.978205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7c5cdf7-a097-4868-815f-bc02339ad722 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.978959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7c5cdf7-a097-4868-815f-bc02339ad722 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:18.979393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7c5cdf7-a097-4868-815f-bc02339ad722 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:18.994135 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-218f7aba-8eaa-4eb7-b173-dc16410f48d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:18.994841 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-218f7aba-8eaa-4eb7-b173-dc16410f48d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:19.001467 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-218f7aba-8eaa-4eb7-b173-dc16410f48d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:19.001906 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-218f7aba-8eaa-4eb7-b173-dc16410f48d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:19.002660 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-218f7aba-8eaa-4eb7-b173-dc16410f48d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:19.003085 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-218f7aba-8eaa-4eb7-b173-dc16410f48d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:19.009573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f7c5cdf7-a097-4868-815f-bc02339ad722 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Jul 18 17:02:19.010198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 405/933] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:18 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:19.067074 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-218f7aba-8eaa-4eb7-b173-dc16410f48d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:19.074753 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-218f7aba-8eaa-4eb7-b173-dc16410f48d3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084357 Jul 18 17:02:19.076154 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 529/934] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:18 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:19.862076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d174817f-588f-4bb7-a071-af5d16f6351f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:19.863134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d174817f-588f-4bb7-a071-af5d16f6351f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:19.873670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d174817f-588f-4bb7-a071-af5d16f6351f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:19.874145 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d174817f-588f-4bb7-a071-af5d16f6351f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:19.875510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d174817f-588f-4bb7-a071-af5d16f6351f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:19.875990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d174817f-588f-4bb7-a071-af5d16f6351f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.016021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d174817f-588f-4bb7-a071-af5d16f6351f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:20.021064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ef248756-4ad7-4ba8-ae93-93168a1c333c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:20.021993 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ef248756-4ad7-4ba8-ae93-93168a1c333c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:20.023943 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=80 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:20.024095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d174817f-588f-4bb7-a071-af5d16f6351f tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.170080 Jul 18 17:02:20.024808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 406/935] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:19 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:20.029219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ef248756-4ad7-4ba8-ae93-93168a1c333c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.029703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ef248756-4ad7-4ba8-ae93-93168a1c333c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.030601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ef248756-4ad7-4ba8-ae93-93168a1c333c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.031041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ef248756-4ad7-4ba8-ae93-93168a1c333c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.061643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ef248756-4ad7-4ba8-ae93-93168a1c333c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Jul 18 17:02:20.062252 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 530/936] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:20 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:20.092508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1a38bd17-98ef-44d2-a828-f2b190f43046 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:20.093114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1a38bd17-98ef-44d2-a828-f2b190f43046 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:20.099174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a38bd17-98ef-44d2-a828-f2b190f43046 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.099679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a38bd17-98ef-44d2-a828-f2b190f43046 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.100424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a38bd17-98ef-44d2-a828-f2b190f43046 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:20.100855 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a38bd17-98ef-44d2-a828-f2b190f43046 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:20.163467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1a38bd17-98ef-44d2-a828-f2b190f43046 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:20.171856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1a38bd17-98ef-44d2-a828-f2b190f43046 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.083644 Jul 18 17:02:20.172686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 407/937] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:20 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:21.041917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-77353484-311e-4d0e-955d-435818eed92d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:21.042514 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-77353484-311e-4d0e-955d-435818eed92d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:21.049849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-77353484-311e-4d0e-955d-435818eed92d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:21.050295 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-77353484-311e-4d0e-955d-435818eed92d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:21.051046 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-77353484-311e-4d0e-955d-435818eed92d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:21.051472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-77353484-311e-4d0e-955d-435818eed92d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:21.073359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-09614115-6bd0-4c9a-9700-d791f92e7079 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:21.074227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-09614115-6bd0-4c9a-9700-d791f92e7079 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:21.081074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09614115-6bd0-4c9a-9700-d791f92e7079 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:21.081517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09614115-6bd0-4c9a-9700-d791f92e7079 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:21.082285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09614115-6bd0-4c9a-9700-d791f92e7079 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:21.082717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-09614115-6bd0-4c9a-9700-d791f92e7079 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:21.114253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-09614115-6bd0-4c9a-9700-d791f92e7079 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Jul 18 17:02:21.114833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 408/938] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:21.189582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bb940ff2-3984-451f-9fa4-fbf2ca38929d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:21.190254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bb940ff2-3984-451f-9fa4-fbf2ca38929d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:21.192048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-77353484-311e-4d0e-955d-435818eed92d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:21.196509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb940ff2-3984-451f-9fa4-fbf2ca38929d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:21.196961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb940ff2-3984-451f-9fa4-fbf2ca38929d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:21.197727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb940ff2-3984-451f-9fa4-fbf2ca38929d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:21.198164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb940ff2-3984-451f-9fa4-fbf2ca38929d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:21.199972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-77353484-311e-4d0e-955d-435818eed92d tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.161894 Jul 18 17:02:21.200588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 531/939] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:21 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:21.260590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bb940ff2-3984-451f-9fa4-fbf2ca38929d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:21.268089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bb940ff2-3984-451f-9fa4-fbf2ca38929d tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.083148 Jul 18 17:02:21.268661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 409/940] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:21 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:22.127086 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e3352921-beff-4977-86a6-06639ffb50e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:22.127939 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e3352921-beff-4977-86a6-06639ffb50e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:22.133983 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3352921-beff-4977-86a6-06639ffb50e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:22.134443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3352921-beff-4977-86a6-06639ffb50e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:22.135182 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3352921-beff-4977-86a6-06639ffb50e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:22.135653 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3352921-beff-4977-86a6-06639ffb50e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:22.166775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e3352921-beff-4977-86a6-06639ffb50e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Jul 18 17:02:22.167388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 532/941] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:22.217086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2673a230-88e8-487f-92b0-d9f52eaee25c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:22.217689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2673a230-88e8-487f-92b0-d9f52eaee25c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:22.220153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=88 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:22.224907 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2673a230-88e8-487f-92b0-d9f52eaee25c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:22.225346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2673a230-88e8-487f-92b0-d9f52eaee25c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:22.226106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2673a230-88e8-487f-92b0-d9f52eaee25c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:22.226564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2673a230-88e8-487f-92b0-d9f52eaee25c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:22.285401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2d08c158-3777-4bc9-b9fb-3ffc7eeb5127 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:22.286020 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2d08c158-3777-4bc9-b9fb-3ffc7eeb5127 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:22.292459 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2d08c158-3777-4bc9-b9fb-3ffc7eeb5127 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:22.292892 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2d08c158-3777-4bc9-b9fb-3ffc7eeb5127 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:22.293649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2d08c158-3777-4bc9-b9fb-3ffc7eeb5127 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:22.294089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2d08c158-3777-4bc9-b9fb-3ffc7eeb5127 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:22.357868 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2d08c158-3777-4bc9-b9fb-3ffc7eeb5127 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:22.365811 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2d08c158-3777-4bc9-b9fb-3ffc7eeb5127 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084436 Jul 18 17:02:22.366388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 533/942] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:22 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:22.373656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2673a230-88e8-487f-92b0-d9f52eaee25c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:22.386627 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2673a230-88e8-487f-92b0-d9f52eaee25c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.173581 Jul 18 17:02:22.387139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 410/943] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:22 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:23.178917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-83398beb-34d9-4109-ac4e-065edaeb8469 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:23.179919 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-83398beb-34d9-4109-ac4e-065edaeb8469 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:23.186152 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-83398beb-34d9-4109-ac4e-065edaeb8469 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:23.186769 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-83398beb-34d9-4109-ac4e-065edaeb8469 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:23.187585 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-83398beb-34d9-4109-ac4e-065edaeb8469 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:23.188019 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-83398beb-34d9-4109-ac4e-065edaeb8469 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:23.217661 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-83398beb-34d9-4109-ac4e-065edaeb8469 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042686 Jul 18 17:02:23.218219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 534/944] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:23 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:23.383089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-925d2e6e-99bd-4128-86eb-310a16ceb248 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:23.383713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-925d2e6e-99bd-4128-86eb-310a16ceb248 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:23.390226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-925d2e6e-99bd-4128-86eb-310a16ceb248 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:23.390669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-925d2e6e-99bd-4128-86eb-310a16ceb248 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:23.391986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-925d2e6e-99bd-4128-86eb-310a16ceb248 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:23.392572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-925d2e6e-99bd-4128-86eb-310a16ceb248 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:23.403927 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e2c99be6-bacd-4129-943d-d91290782b0b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:23.404443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e2c99be6-bacd-4129-943d-d91290782b0b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:23.411465 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e2c99be6-bacd-4129-943d-d91290782b0b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:23.411941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e2c99be6-bacd-4129-943d-d91290782b0b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:23.412708 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e2c99be6-bacd-4129-943d-d91290782b0b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:23.413141 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e2c99be6-bacd-4129-943d-d91290782b0b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:23.417397 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:23.460670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-925d2e6e-99bd-4128-86eb-310a16ceb248 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:23.468388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-925d2e6e-99bd-4128-86eb-310a16ceb248 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.089116 Jul 18 17:02:23.469072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 411/945] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:23 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:23.550033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e2c99be6-bacd-4129-943d-d91290782b0b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:23.558246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e2c99be6-bacd-4129-943d-d91290782b0b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.158143 Jul 18 17:02:23.558838 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 535/946] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:23 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:24.232691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ac5bfad9-4e30-4f95-bd62-fdc3d4c82891 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:24.232691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ac5bfad9-4e30-4f95-bd62-fdc3d4c82891 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:24.238478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac5bfad9-4e30-4f95-bd62-fdc3d4c82891 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:24.239014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac5bfad9-4e30-4f95-bd62-fdc3d4c82891 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:24.239818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac5bfad9-4e30-4f95-bd62-fdc3d4c82891 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:24.240258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac5bfad9-4e30-4f95-bd62-fdc3d4c82891 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:24.244388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:24.275164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ac5bfad9-4e30-4f95-bd62-fdc3d4c82891 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049140 Jul 18 17:02:24.275858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 412/947] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:24.486984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d086aa87-03fd-4da6-98e9-df6cf398e148 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:24.487562 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d086aa87-03fd-4da6-98e9-df6cf398e148 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:24.494805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d086aa87-03fd-4da6-98e9-df6cf398e148 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:24.495258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d086aa87-03fd-4da6-98e9-df6cf398e148 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:24.496047 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d086aa87-03fd-4da6-98e9-df6cf398e148 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:24.496479 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d086aa87-03fd-4da6-98e9-df6cf398e148 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:24.578613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f8f4e403-c4e9-4943-bffd-53cca8f98685 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:24.579997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f8f4e403-c4e9-4943-bffd-53cca8f98685 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:24.581609 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d086aa87-03fd-4da6-98e9-df6cf398e148 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:24.587472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8f4e403-c4e9-4943-bffd-53cca8f98685 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:24.588038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8f4e403-c4e9-4943-bffd-53cca8f98685 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:24.588820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8f4e403-c4e9-4943-bffd-53cca8f98685 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:24.589326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8f4e403-c4e9-4943-bffd-53cca8f98685 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:24.592499 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d086aa87-03fd-4da6-98e9-df6cf398e148 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.109349 Jul 18 17:02:24.593075 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 536/948] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:24 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:24.745977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f8f4e403-c4e9-4943-bffd-53cca8f98685 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:24.755549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f8f4e403-c4e9-4943-bffd-53cca8f98685 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.182986 Jul 18 17:02:24.756166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 413/949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:24 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:25.289285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a04e3268-01c3-46a6-b231-e1d59ada36c6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:25.290240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a04e3268-01c3-46a6-b231-e1d59ada36c6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:25.296453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a04e3268-01c3-46a6-b231-e1d59ada36c6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:25.296902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a04e3268-01c3-46a6-b231-e1d59ada36c6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:25.298638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a04e3268-01c3-46a6-b231-e1d59ada36c6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:25.299126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a04e3268-01c3-46a6-b231-e1d59ada36c6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:25.328482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a04e3268-01c3-46a6-b231-e1d59ada36c6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043562 Jul 18 17:02:25.329638 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 537/950] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:25.610963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4f1ab2d1-6337-4bb6-9233-e91efc80e27f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:25.611526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4f1ab2d1-6337-4bb6-9233-e91efc80e27f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:25.618352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f1ab2d1-6337-4bb6-9233-e91efc80e27f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:25.618808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f1ab2d1-6337-4bb6-9233-e91efc80e27f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:25.619632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f1ab2d1-6337-4bb6-9233-e91efc80e27f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:25.620075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f1ab2d1-6337-4bb6-9233-e91efc80e27f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:25.685870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f1ab2d1-6337-4bb6-9233-e91efc80e27f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:25.693982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4f1ab2d1-6337-4bb6-9233-e91efc80e27f tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.087180 Jul 18 17:02:25.694550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 414/951] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:25 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:25.773691 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-50127916-ae30-41bb-bf26-4fc7552651e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:25.774300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-50127916-ae30-41bb-bf26-4fc7552651e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:25.780671 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-50127916-ae30-41bb-bf26-4fc7552651e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:25.781116 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-50127916-ae30-41bb-bf26-4fc7552651e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:25.781866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-50127916-ae30-41bb-bf26-4fc7552651e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:25.782323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-50127916-ae30-41bb-bf26-4fc7552651e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:25.916919 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-50127916-ae30-41bb-bf26-4fc7552651e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:25.925577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-50127916-ae30-41bb-bf26-4fc7552651e3 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.155644 Jul 18 17:02:25.926141 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 538/952] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:25 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:26.340965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4e265097-7b39-46d9-bdf6-71eba20ca4a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:26.341979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4e265097-7b39-46d9-bdf6-71eba20ca4a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:26.348848 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e265097-7b39-46d9-bdf6-71eba20ca4a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:26.349301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e265097-7b39-46d9-bdf6-71eba20ca4a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:26.350078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e265097-7b39-46d9-bdf6-71eba20ca4a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:26.350519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e265097-7b39-46d9-bdf6-71eba20ca4a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:26.385724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4e265097-7b39-46d9-bdf6-71eba20ca4a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049299 Jul 18 17:02:26.386273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 415/953] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:26.710183 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d117c9b4-2de5-4638-b8df-76c2c1a5b9f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:26.710770 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d117c9b4-2de5-4638-b8df-76c2c1a5b9f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:26.716990 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d117c9b4-2de5-4638-b8df-76c2c1a5b9f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:26.717546 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d117c9b4-2de5-4638-b8df-76c2c1a5b9f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:26.718310 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d117c9b4-2de5-4638-b8df-76c2c1a5b9f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:26.718743 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d117c9b4-2de5-4638-b8df-76c2c1a5b9f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:26.783915 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d117c9b4-2de5-4638-b8df-76c2c1a5b9f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:26.791516 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d117c9b4-2de5-4638-b8df-76c2c1a5b9f3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085237 Jul 18 17:02:26.792099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 539/954] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:26 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:26.943433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-293b8b89-958f-4565-9c0c-7094e4711f08 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:26.944138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-293b8b89-958f-4565-9c0c-7094e4711f08 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:26.950939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-293b8b89-958f-4565-9c0c-7094e4711f08 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:26.951388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-293b8b89-958f-4565-9c0c-7094e4711f08 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:26.952181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-293b8b89-958f-4565-9c0c-7094e4711f08 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:26.952622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-293b8b89-958f-4565-9c0c-7094e4711f08 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:27.090852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-293b8b89-958f-4565-9c0c-7094e4711f08 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:27.100506 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-293b8b89-958f-4565-9c0c-7094e4711f08 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.160950 Jul 18 17:02:27.101134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 416/955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:26 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:27.398530 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a19b353c-3af4-4c27-bf3f-14c301b5a64b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:27.399398 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a19b353c-3af4-4c27-bf3f-14c301b5a64b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:27.406754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a19b353c-3af4-4c27-bf3f-14c301b5a64b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:27.408073 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a19b353c-3af4-4c27-bf3f-14c301b5a64b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:27.408936 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a19b353c-3af4-4c27-bf3f-14c301b5a64b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:27.409369 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a19b353c-3af4-4c27-bf3f-14c301b5a64b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:27.440874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a19b353c-3af4-4c27-bf3f-14c301b5a64b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046426 Jul 18 17:02:27.441776 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 540/956] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:27.809990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5a962a4e-4c23-43a0-ad63-ee84bb877869 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:27.810603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5a962a4e-4c23-43a0-ad63-ee84bb877869 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:27.816742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a962a4e-4c23-43a0-ad63-ee84bb877869 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:27.817345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a962a4e-4c23-43a0-ad63-ee84bb877869 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:27.817929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a962a4e-4c23-43a0-ad63-ee84bb877869 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:27.818367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a962a4e-4c23-43a0-ad63-ee84bb877869 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:27.879978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5a962a4e-4c23-43a0-ad63-ee84bb877869 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:27.887662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5a962a4e-4c23-43a0-ad63-ee84bb877869 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.081457 Jul 18 17:02:27.888305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 417/957] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:27 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:28.119537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8cf66dfd-2c86-4a63-aed1-dafeaed96f1a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:28.120080 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8cf66dfd-2c86-4a63-aed1-dafeaed96f1a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:28.127650 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cf66dfd-2c86-4a63-aed1-dafeaed96f1a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:28.128091 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cf66dfd-2c86-4a63-aed1-dafeaed96f1a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:28.128846 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cf66dfd-2c86-4a63-aed1-dafeaed96f1a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:28.129275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cf66dfd-2c86-4a63-aed1-dafeaed96f1a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:28.262083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8cf66dfd-2c86-4a63-aed1-dafeaed96f1a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:28.270581 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8cf66dfd-2c86-4a63-aed1-dafeaed96f1a tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.154936 Jul 18 17:02:28.271139 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 541/958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:28 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:28.453975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c5dc5341-2420-4434-83f0-c80e4dd7b838 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:28.454815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c5dc5341-2420-4434-83f0-c80e4dd7b838 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:28.462251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5dc5341-2420-4434-83f0-c80e4dd7b838 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:28.462251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5dc5341-2420-4434-83f0-c80e4dd7b838 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:28.462568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5dc5341-2420-4434-83f0-c80e4dd7b838 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:28.463011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5dc5341-2420-4434-83f0-c80e4dd7b838 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:28.493189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c5dc5341-2420-4434-83f0-c80e4dd7b838 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Jul 18 17:02:28.493757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 418/959] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:28 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:28.905374 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-98a15ef1-3b08-4bfc-8a73-bda32f3462c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:28.905975 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-98a15ef1-3b08-4bfc-8a73-bda32f3462c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:28.912795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98a15ef1-3b08-4bfc-8a73-bda32f3462c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:28.913235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98a15ef1-3b08-4bfc-8a73-bda32f3462c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:28.914189 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98a15ef1-3b08-4bfc-8a73-bda32f3462c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:28.914623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98a15ef1-3b08-4bfc-8a73-bda32f3462c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:28.976789 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-98a15ef1-3b08-4bfc-8a73-bda32f3462c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:28.984382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-98a15ef1-3b08-4bfc-8a73-bda32f3462c4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.082881 Jul 18 17:02:28.984953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 542/960] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:28 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:29.288942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f2f99a9f-f034-4662-acc3-559a33368c33 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:29.289551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f2f99a9f-f034-4662-acc3-559a33368c33 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:29.295637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2f99a9f-f034-4662-acc3-559a33368c33 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:29.296089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2f99a9f-f034-4662-acc3-559a33368c33 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:29.296846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2f99a9f-f034-4662-acc3-559a33368c33 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:29.297289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2f99a9f-f034-4662-acc3-559a33368c33 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:29.430379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f2f99a9f-f034-4662-acc3-559a33368c33 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:29.438352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f2f99a9f-f034-4662-acc3-559a33368c33 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66" status: 200 len: 1732 microversion: 2.1 time: 0.153267 Jul 18 17:02:29.439038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 419/961] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:29 2022] GET /compute/v2.1/servers/9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:29.454835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bd0ce50b-e44d-4cd9-8c88-bc1bd9e5d193 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '.version_select at 0x7fd6ae03a700>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:29.504791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1a06f81f-0b1b-4dea-a6f1-aac0209f1421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:29.505699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1a06f81f-0b1b-4dea-a6f1-aac0209f1421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:29.512068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a06f81f-0b1b-4dea-a6f1-aac0209f1421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:29.512591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a06f81f-0b1b-4dea-a6f1-aac0209f1421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:29.513256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a06f81f-0b1b-4dea-a6f1-aac0209f1421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:29.513691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a06f81f-0b1b-4dea-a6f1-aac0209f1421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:29.530571 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bd0ce50b-e44d-4cd9-8c88-bc1bd9e5d193 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894990276" status: 202 len: 0 microversion: 2.1 time: 0.080087 Jul 18 17:02:29.531250 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 543/962] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 18 17:02:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894990276 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:02:29.546671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1a06f81f-0b1b-4dea-a6f1-aac0209f1421 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044043 Jul 18 17:02:29.546671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 420/963] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:29 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:30.002432 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-09c6109b-65a9-4123-8b1a-6738f81233e3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:30.003031 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-09c6109b-65a9-4123-8b1a-6738f81233e3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:30.009184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09c6109b-65a9-4123-8b1a-6738f81233e3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:30.009628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09c6109b-65a9-4123-8b1a-6738f81233e3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:30.010378 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09c6109b-65a9-4123-8b1a-6738f81233e3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:30.010809 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09c6109b-65a9-4123-8b1a-6738f81233e3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:30.073003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-09c6109b-65a9-4123-8b1a-6738f81233e3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:30.080972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-09c6109b-65a9-4123-8b1a-6738f81233e3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.083084 Jul 18 17:02:30.081564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 544/964] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:29 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:30.557525 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dc9564a6-9eee-4e5f-829b-483c90469373 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:30.558448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dc9564a6-9eee-4e5f-829b-483c90469373 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:30.582676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc9564a6-9eee-4e5f-829b-483c90469373 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:30.584357 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc9564a6-9eee-4e5f-829b-483c90469373 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:30.587110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc9564a6-9eee-4e5f-829b-483c90469373 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:30.588903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc9564a6-9eee-4e5f-829b-483c90469373 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:30.645794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dc9564a6-9eee-4e5f-829b-483c90469373 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092374 Jul 18 17:02:30.646884 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 545/965] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:30.681988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-38bb01c0-1c69-4298-b051-dfd3b9584478 req-d02e80f0-5ed5-4caf-89ab-bb4af1f72894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66", "tag": "92032a26-dcdf-4f60-ac35-52156a6604c6"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:30.691014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-38bb01c0-1c69-4298-b051-dfd3b9584478 req-d02e80f0-5ed5-4caf-89ab-bb4af1f72894 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:30.691465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-38bb01c0-1c69-4298-b051-dfd3b9584478 req-d02e80f0-5ed5-4caf-89ab-bb4af1f72894 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:30.705144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-38bb01c0-1c69-4298-b051-dfd3b9584478 req-d02e80f0-5ed5-4caf-89ab-bb4af1f72894 service nova] Creating event network-changed:92032a26-dcdf-4f60-ac35-52156a6604c6 for instance 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 on hv-cinder-84617 Jul 18 17:02:30.710535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-38bb01c0-1c69-4298-b051-dfd3b9584478 req-d02e80f0-5ed5-4caf-89ab-bb4af1f72894 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165689 Jul 18 17:02:30.711144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 421/966] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:31.099010 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-52a52416-b3a7-4e73-abc5-decc256339ac tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:31.099930 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-52a52416-b3a7-4e73-abc5-decc256339ac tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:31.106083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52a52416-b3a7-4e73-abc5-decc256339ac tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:31.106775 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52a52416-b3a7-4e73-abc5-decc256339ac tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:31.107736 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52a52416-b3a7-4e73-abc5-decc256339ac tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:31.108320 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52a52416-b3a7-4e73-abc5-decc256339ac tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:31.175236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-52a52416-b3a7-4e73-abc5-decc256339ac tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:31.184171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-52a52416-b3a7-4e73-abc5-decc256339ac tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.088746 Jul 18 17:02:31.185322 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 546/967] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:31 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:31.663818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d7cfa737-f49e-4d46-8a48-1b6304341b8f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:31.665753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d7cfa737-f49e-4d46-8a48-1b6304341b8f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:31.676951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7cfa737-f49e-4d46-8a48-1b6304341b8f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:31.677449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7cfa737-f49e-4d46-8a48-1b6304341b8f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:31.678259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7cfa737-f49e-4d46-8a48-1b6304341b8f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:31.678731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7cfa737-f49e-4d46-8a48-1b6304341b8f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:31.710841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d7cfa737-f49e-4d46-8a48-1b6304341b8f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055585 Jul 18 17:02:31.711679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 422/968] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:32.202036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ccf78ec7-b205-4ec7-8e69-23f8e8d63ce8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:32.202644 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ccf78ec7-b205-4ec7-8e69-23f8e8d63ce8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:32.209290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ccf78ec7-b205-4ec7-8e69-23f8e8d63ce8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:32.209739 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ccf78ec7-b205-4ec7-8e69-23f8e8d63ce8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:32.210508 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ccf78ec7-b205-4ec7-8e69-23f8e8d63ce8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:32.210944 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ccf78ec7-b205-4ec7-8e69-23f8e8d63ce8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:32.278546 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ccf78ec7-b205-4ec7-8e69-23f8e8d63ce8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:32.292871 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ccf78ec7-b205-4ec7-8e69-23f8e8d63ce8 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.094720 Jul 18 17:02:32.293567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 547/969] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:32 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:32.505043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-378264ae-819b-44c7-8fa9-2a1d984ab091 req-a8895db2-da6f-4755-89c4-0a907b4ea593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66", "name": "network-vif-deleted", "tag": "92032a26-dcdf-4f60-ac35-52156a6604c6"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:02:32.512787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-378264ae-819b-44c7-8fa9-2a1d984ab091 req-a8895db2-da6f-4755-89c4-0a907b4ea593 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:32.513229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-378264ae-819b-44c7-8fa9-2a1d984ab091 req-a8895db2-da6f-4755-89c4-0a907b4ea593 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:32.525923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-378264ae-819b-44c7-8fa9-2a1d984ab091 req-a8895db2-da6f-4755-89c4-0a907b4ea593 service nova] Creating event network-vif-deleted:92032a26-dcdf-4f60-ac35-52156a6604c6 for instance 9f2b8bd2-6fc9-489d-a7d6-1145f2ffca66 on hv-cinder-84617 Jul 18 17:02:32.531023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-378264ae-819b-44c7-8fa9-2a1d984ab091 req-a8895db2-da6f-4755-89c4-0a907b4ea593 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030747 Jul 18 17:02:32.531639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 423/970] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:32.722293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ad290696-03e2-459f-8557-b8be0878fe88 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:32.723269 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ad290696-03e2-459f-8557-b8be0878fe88 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:32.729548 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad290696-03e2-459f-8557-b8be0878fe88 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:32.729994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad290696-03e2-459f-8557-b8be0878fe88 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:32.730753 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad290696-03e2-459f-8557-b8be0878fe88 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:32.731186 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ad290696-03e2-459f-8557-b8be0878fe88 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:32.761941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ad290696-03e2-459f-8557-b8be0878fe88 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 Jul 18 17:02:32.762500 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 548/971] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:33.315737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-05bbecf6-0ae7-43bf-a051-68bd5b7abe61 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:33.316423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-05bbecf6-0ae7-43bf-a051-68bd5b7abe61 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:33.322867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-05bbecf6-0ae7-43bf-a051-68bd5b7abe61 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:33.323315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-05bbecf6-0ae7-43bf-a051-68bd5b7abe61 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:33.324100 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-05bbecf6-0ae7-43bf-a051-68bd5b7abe61 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:33.324529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-05bbecf6-0ae7-43bf-a051-68bd5b7abe61 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:33.398510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-05bbecf6-0ae7-43bf-a051-68bd5b7abe61 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:33.406099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-05bbecf6-0ae7-43bf-a051-68bd5b7abe61 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.095796 Jul 18 17:02:33.406685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 424/972] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:33 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:33.774018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-93ff3cb9-7d4d-4a28-bfc8-fc0acb92acc7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:33.774954 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-93ff3cb9-7d4d-4a28-bfc8-fc0acb92acc7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:33.781289 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-93ff3cb9-7d4d-4a28-bfc8-fc0acb92acc7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:33.781736 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-93ff3cb9-7d4d-4a28-bfc8-fc0acb92acc7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:33.783097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-93ff3cb9-7d4d-4a28-bfc8-fc0acb92acc7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:33.783639 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-93ff3cb9-7d4d-4a28-bfc8-fc0acb92acc7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:33.813628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-93ff3cb9-7d4d-4a28-bfc8-fc0acb92acc7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Jul 18 17:02:33.814189 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 549/973] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:33 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:34.424646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a9ee50f4-21b0-488e-8290-f21b31401846 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:34.425218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a9ee50f4-21b0-488e-8290-f21b31401846 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:34.431788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a9ee50f4-21b0-488e-8290-f21b31401846 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:34.432229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a9ee50f4-21b0-488e-8290-f21b31401846 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:34.432986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a9ee50f4-21b0-488e-8290-f21b31401846 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:34.433418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a9ee50f4-21b0-488e-8290-f21b31401846 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:34.654920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a9ee50f4-21b0-488e-8290-f21b31401846 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:34.660060 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a9ee50f4-21b0-488e-8290-f21b31401846 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.240047 Jul 18 17:02:34.660864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 425/974] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:34 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:34.825389 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d0bb6c64-18b9-4fb9-8099-dd3672b9d327 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:34.826316 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d0bb6c64-18b9-4fb9-8099-dd3672b9d327 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:34.833026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d0bb6c64-18b9-4fb9-8099-dd3672b9d327 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:34.833476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d0bb6c64-18b9-4fb9-8099-dd3672b9d327 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:34.834246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d0bb6c64-18b9-4fb9-8099-dd3672b9d327 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:34.834685 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d0bb6c64-18b9-4fb9-8099-dd3672b9d327 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:34.866939 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d0bb6c64-18b9-4fb9-8099-dd3672b9d327 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045364 Jul 18 17:02:34.867410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 550/975] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:34 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:35.677436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-20601d07-4023-46aa-b2f2-e9a7056b0ce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:35.678032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-20601d07-4023-46aa-b2f2-e9a7056b0ce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:35.684710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20601d07-4023-46aa-b2f2-e9a7056b0ce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:35.685158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20601d07-4023-46aa-b2f2-e9a7056b0ce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:35.685919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20601d07-4023-46aa-b2f2-e9a7056b0ce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:35.686354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20601d07-4023-46aa-b2f2-e9a7056b0ce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:35.749473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-20601d07-4023-46aa-b2f2-e9a7056b0ce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:35.757610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-20601d07-4023-46aa-b2f2-e9a7056b0ce7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084069 Jul 18 17:02:35.758165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 426/976] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:35 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:35.879245 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e9518beb-2de4-423b-9e94-93b9b92374eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:35.880266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e9518beb-2de4-423b-9e94-93b9b92374eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:35.886266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e9518beb-2de4-423b-9e94-93b9b92374eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:35.886715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e9518beb-2de4-423b-9e94-93b9b92374eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:35.887535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e9518beb-2de4-423b-9e94-93b9b92374eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:35.887969 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e9518beb-2de4-423b-9e94-93b9b92374eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:35.916786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e9518beb-2de4-423b-9e94-93b9b92374eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042373 Jul 18 17:02:35.917329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 551/977] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:36.774889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9aa9894b-2ddb-468a-9517-003dbed5b3dc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:36.775516 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9aa9894b-2ddb-468a-9517-003dbed5b3dc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:36.782602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9aa9894b-2ddb-468a-9517-003dbed5b3dc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:36.783105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9aa9894b-2ddb-468a-9517-003dbed5b3dc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:36.783930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9aa9894b-2ddb-468a-9517-003dbed5b3dc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:36.784365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9aa9894b-2ddb-468a-9517-003dbed5b3dc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:36.846192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9aa9894b-2ddb-468a-9517-003dbed5b3dc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:36.853939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9aa9894b-2ddb-468a-9517-003dbed5b3dc tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.082879 Jul 18 17:02:36.854515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 427/978] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:36 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:36.927757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5a414103-fad3-4c9e-bfbc-1ee547054b1b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:36.928678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5a414103-fad3-4c9e-bfbc-1ee547054b1b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:36.934808 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a414103-fad3-4c9e-bfbc-1ee547054b1b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:36.935253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a414103-fad3-4c9e-bfbc-1ee547054b1b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:36.936050 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a414103-fad3-4c9e-bfbc-1ee547054b1b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:36.936485 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5a414103-fad3-4c9e-bfbc-1ee547054b1b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:36.961811 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:36.966301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5a414103-fad3-4c9e-bfbc-1ee547054b1b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Jul 18 17:02:36.966917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 552/979] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:36 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:37.871244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-53acf5da-0689-4ad5-a7cb-a30b06524376 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:37.871884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-53acf5da-0689-4ad5-a7cb-a30b06524376 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:37.878415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53acf5da-0689-4ad5-a7cb-a30b06524376 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:37.878857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53acf5da-0689-4ad5-a7cb-a30b06524376 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:37.879668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53acf5da-0689-4ad5-a7cb-a30b06524376 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:37.880106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53acf5da-0689-4ad5-a7cb-a30b06524376 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:37.941215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-53acf5da-0689-4ad5-a7cb-a30b06524376 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:37.948720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-53acf5da-0689-4ad5-a7cb-a30b06524376 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.081376 Jul 18 17:02:37.949269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 428/980] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:37 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:37.983448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1ec01bcd-e2a9-433c-829d-244459b894f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:37.984444 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1ec01bcd-e2a9-433c-829d-244459b894f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:37.991171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1ec01bcd-e2a9-433c-829d-244459b894f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:37.991650 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1ec01bcd-e2a9-433c-829d-244459b894f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:37.992470 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1ec01bcd-e2a9-433c-829d-244459b894f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:37.992905 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1ec01bcd-e2a9-433c-829d-244459b894f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:38.021653 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1ec01bcd-e2a9-433c-829d-244459b894f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042422 Jul 18 17:02:38.022223 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 553/981] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:37 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:38.965462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-96408eba-f23f-4d31-8dc3-af4b25d051e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:38.966059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-96408eba-f23f-4d31-8dc3-af4b25d051e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:38.972589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-96408eba-f23f-4d31-8dc3-af4b25d051e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:38.973036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-96408eba-f23f-4d31-8dc3-af4b25d051e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:38.973785 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-96408eba-f23f-4d31-8dc3-af4b25d051e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:38.974217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-96408eba-f23f-4d31-8dc3-af4b25d051e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:39.033513 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-438feaea-d669-49cd-b359-19b375fa8bc9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:39.034480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-438feaea-d669-49cd-b359-19b375fa8bc9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:39.037777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-96408eba-f23f-4d31-8dc3-af4b25d051e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:39.041070 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-438feaea-d669-49cd-b359-19b375fa8bc9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:39.041525 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-438feaea-d669-49cd-b359-19b375fa8bc9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:39.042290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-438feaea-d669-49cd-b359-19b375fa8bc9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:39.042731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-438feaea-d669-49cd-b359-19b375fa8bc9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:39.045703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-96408eba-f23f-4d31-8dc3-af4b25d051e4 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084046 Jul 18 17:02:39.047113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 429/982] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:38 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:39.072690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-438feaea-d669-49cd-b359-19b375fa8bc9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Jul 18 17:02:39.073244 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 554/983] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:39 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:40.062202 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8948fa61-9d9e-46be-bcd8-a73d457a88e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:40.062834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8948fa61-9d9e-46be-bcd8-a73d457a88e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:40.070311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8948fa61-9d9e-46be-bcd8-a73d457a88e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:40.070758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8948fa61-9d9e-46be-bcd8-a73d457a88e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:40.073427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8948fa61-9d9e-46be-bcd8-a73d457a88e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:40.073427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8948fa61-9d9e-46be-bcd8-a73d457a88e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:40.076258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:40.084920 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2badbcb2-2d4a-4297-a35b-562f6a78c9e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:40.086205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2badbcb2-2d4a-4297-a35b-562f6a78c9e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:40.093564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2badbcb2-2d4a-4297-a35b-562f6a78c9e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:40.094014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2badbcb2-2d4a-4297-a35b-562f6a78c9e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:40.094842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2badbcb2-2d4a-4297-a35b-562f6a78c9e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:40.095260 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2badbcb2-2d4a-4297-a35b-562f6a78c9e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:40.127557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2badbcb2-2d4a-4297-a35b-562f6a78c9e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046765 Jul 18 17:02:40.128127 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 555/984] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:40 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:40.135455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8948fa61-9d9e-46be-bcd8-a73d457a88e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:40.143677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8948fa61-9d9e-46be-bcd8-a73d457a88e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085315 Jul 18 17:02:40.144225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 430/985] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:40 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:41.139127 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-eea00269-6db7-4927-b7fe-307fd12e0b95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:41.140070 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-eea00269-6db7-4927-b7fe-307fd12e0b95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:41.146669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eea00269-6db7-4927-b7fe-307fd12e0b95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:41.147110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eea00269-6db7-4927-b7fe-307fd12e0b95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:41.147905 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eea00269-6db7-4927-b7fe-307fd12e0b95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:41.148351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-eea00269-6db7-4927-b7fe-307fd12e0b95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:41.160384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e5deeb2a-21ab-4f59-be22-fd9b1c9b233c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:41.161061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e5deeb2a-21ab-4f59-be22-fd9b1c9b233c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:41.167477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e5deeb2a-21ab-4f59-be22-fd9b1c9b233c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:41.167947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e5deeb2a-21ab-4f59-be22-fd9b1c9b233c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:41.168700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e5deeb2a-21ab-4f59-be22-fd9b1c9b233c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:41.169127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e5deeb2a-21ab-4f59-be22-fd9b1c9b233c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:41.179445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-eea00269-6db7-4927-b7fe-307fd12e0b95 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 Jul 18 17:02:41.180050 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 556/986] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:41 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:41.233214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e5deeb2a-21ab-4f59-be22-fd9b1c9b233c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:41.241323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e5deeb2a-21ab-4f59-be22-fd9b1c9b233c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085617 Jul 18 17:02:41.245745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 431/987] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:41 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:42.191314 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bd955ea0-ea8e-4aaa-981e-720abf3abb5d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:42.192178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bd955ea0-ea8e-4aaa-981e-720abf3abb5d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:42.198219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd955ea0-ea8e-4aaa-981e-720abf3abb5d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:42.198670 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd955ea0-ea8e-4aaa-981e-720abf3abb5d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:42.199423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd955ea0-ea8e-4aaa-981e-720abf3abb5d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:42.199887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bd955ea0-ea8e-4aaa-981e-720abf3abb5d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:42.229572 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bd955ea0-ea8e-4aaa-981e-720abf3abb5d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Jul 18 17:02:42.230142 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 557/988] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:42 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:42.259409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7ff24dcd-6fec-4ba5-9337-86ca726f45e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:42.266350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7ff24dcd-6fec-4ba5-9337-86ca726f45e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:42.266892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ff24dcd-6fec-4ba5-9337-86ca726f45e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:42.267353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ff24dcd-6fec-4ba5-9337-86ca726f45e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:42.268207 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ff24dcd-6fec-4ba5-9337-86ca726f45e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:42.268645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ff24dcd-6fec-4ba5-9337-86ca726f45e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:42.331543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7ff24dcd-6fec-4ba5-9337-86ca726f45e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:42.339115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7ff24dcd-6fec-4ba5-9337-86ca726f45e7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084054 Jul 18 17:02:42.339697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 432/989] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:42 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:43.241442 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ea3a4b82-62dd-402b-bfcc-906e50eb5125 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:43.242276 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ea3a4b82-62dd-402b-bfcc-906e50eb5125 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:43.248386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea3a4b82-62dd-402b-bfcc-906e50eb5125 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:43.248829 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea3a4b82-62dd-402b-bfcc-906e50eb5125 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:43.249593 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea3a4b82-62dd-402b-bfcc-906e50eb5125 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:43.250024 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea3a4b82-62dd-402b-bfcc-906e50eb5125 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:43.280921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ea3a4b82-62dd-402b-bfcc-906e50eb5125 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 Jul 18 17:02:43.281482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 558/990] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:43 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:43.356435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1b76511a-7a5d-4ba0-be17-ab0b90deb102 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:43.357034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1b76511a-7a5d-4ba0-be17-ab0b90deb102 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:43.364366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b76511a-7a5d-4ba0-be17-ab0b90deb102 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:43.364809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b76511a-7a5d-4ba0-be17-ab0b90deb102 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:43.365588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b76511a-7a5d-4ba0-be17-ab0b90deb102 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:43.366006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b76511a-7a5d-4ba0-be17-ab0b90deb102 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:43.431068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1b76511a-7a5d-4ba0-be17-ab0b90deb102 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:43.439427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1b76511a-7a5d-4ba0-be17-ab0b90deb102 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.086920 Jul 18 17:02:43.440007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 433/991] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:43 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:44.293287 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f2def553-ceb0-454c-a7df-0c664dc08bc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:44.294222 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f2def553-ceb0-454c-a7df-0c664dc08bc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:44.301662 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f2def553-ceb0-454c-a7df-0c664dc08bc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:44.302101 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f2def553-ceb0-454c-a7df-0c664dc08bc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:44.302887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f2def553-ceb0-454c-a7df-0c664dc08bc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:44.303312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f2def553-ceb0-454c-a7df-0c664dc08bc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:44.332964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f2def553-ceb0-454c-a7df-0c664dc08bc1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Jul 18 17:02:44.333537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 559/992] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:44 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:44.456721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4a4d6224-821e-40c3-9dcc-d11855f371e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:44.457354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4a4d6224-821e-40c3-9dcc-d11855f371e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:44.463975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a4d6224-821e-40c3-9dcc-d11855f371e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:44.464432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a4d6224-821e-40c3-9dcc-d11855f371e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:44.465192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a4d6224-821e-40c3-9dcc-d11855f371e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:44.465631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a4d6224-821e-40c3-9dcc-d11855f371e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:44.530285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4a4d6224-821e-40c3-9dcc-d11855f371e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:44.538260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4a4d6224-821e-40c3-9dcc-d11855f371e5 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085833 Jul 18 17:02:44.538840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 434/993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:44 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:45.345025 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2b0b7377-9ba6-4f7f-9c87-ef655a6f2fa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:45.346058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2b0b7377-9ba6-4f7f-9c87-ef655a6f2fa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:45.352036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2b0b7377-9ba6-4f7f-9c87-ef655a6f2fa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:45.352472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2b0b7377-9ba6-4f7f-9c87-ef655a6f2fa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:45.353220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2b0b7377-9ba6-4f7f-9c87-ef655a6f2fa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:45.353647 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2b0b7377-9ba6-4f7f-9c87-ef655a6f2fa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:45.381723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2b0b7377-9ba6-4f7f-9c87-ef655a6f2fa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041316 Jul 18 17:02:45.382262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 560/994] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:45 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:45.556061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6f4b283b-bacf-41b2-b402-b86b855d13ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:45.556672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6f4b283b-bacf-41b2-b402-b86b855d13ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:45.563778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f4b283b-bacf-41b2-b402-b86b855d13ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:45.569423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f4b283b-bacf-41b2-b402-b86b855d13ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:45.569423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f4b283b-bacf-41b2-b402-b86b855d13ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:45.569423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f4b283b-bacf-41b2-b402-b86b855d13ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:45.630830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6f4b283b-bacf-41b2-b402-b86b855d13ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:45.638478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6f4b283b-bacf-41b2-b402-b86b855d13ff tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.086412 Jul 18 17:02:45.639031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 435/995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:45 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:46.393785 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bcf358ff-fd0c-4f37-92e2-4c14dd706576 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:46.394703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bcf358ff-fd0c-4f37-92e2-4c14dd706576 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:46.400783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bcf358ff-fd0c-4f37-92e2-4c14dd706576 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:46.401223 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bcf358ff-fd0c-4f37-92e2-4c14dd706576 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:46.401977 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bcf358ff-fd0c-4f37-92e2-4c14dd706576 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:46.402407 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bcf358ff-fd0c-4f37-92e2-4c14dd706576 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:46.432067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bcf358ff-fd0c-4f37-92e2-4c14dd706576 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042517 Jul 18 17:02:46.432608 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 561/996] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:46 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:46.656140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a5c1e6e1-7e71-4597-867c-cd448acabb31 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:46.657290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a5c1e6e1-7e71-4597-867c-cd448acabb31 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:46.664146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5c1e6e1-7e71-4597-867c-cd448acabb31 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:46.664591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5c1e6e1-7e71-4597-867c-cd448acabb31 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:46.665357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5c1e6e1-7e71-4597-867c-cd448acabb31 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:46.665795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5c1e6e1-7e71-4597-867c-cd448acabb31 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:46.728682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a5c1e6e1-7e71-4597-867c-cd448acabb31 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:46.737085 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a5c1e6e1-7e71-4597-867c-cd448acabb31 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084869 Jul 18 17:02:46.737656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 436/997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:46 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:47.444972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2ed1fe91-086e-43b0-aeb7-6737cb2ff4b3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:47.445909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2ed1fe91-086e-43b0-aeb7-6737cb2ff4b3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:47.453401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ed1fe91-086e-43b0-aeb7-6737cb2ff4b3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:47.453843 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ed1fe91-086e-43b0-aeb7-6737cb2ff4b3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:47.454646 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ed1fe91-086e-43b0-aeb7-6737cb2ff4b3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:47.455071 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2ed1fe91-086e-43b0-aeb7-6737cb2ff4b3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:47.486378 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2ed1fe91-086e-43b0-aeb7-6737cb2ff4b3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Jul 18 17:02:47.486946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 562/998] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:47 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:47.754608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d4a5368a-f828-4244-967c-3ebda551856e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:47.755185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d4a5368a-f828-4244-967c-3ebda551856e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:47.762042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d4a5368a-f828-4244-967c-3ebda551856e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:47.762479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d4a5368a-f828-4244-967c-3ebda551856e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:47.763229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d4a5368a-f828-4244-967c-3ebda551856e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:47.763683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d4a5368a-f828-4244-967c-3ebda551856e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:47.831466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d4a5368a-f828-4244-967c-3ebda551856e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:47.836927 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d4a5368a-f828-4244-967c-3ebda551856e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.086944 Jul 18 17:02:47.838025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 437/999] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:47 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:48.498046 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-52bd2e34-5237-4749-9dd8-55fbddfc4c13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:48.498990 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-52bd2e34-5237-4749-9dd8-55fbddfc4c13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:48.505499 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52bd2e34-5237-4749-9dd8-55fbddfc4c13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:48.505934 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52bd2e34-5237-4749-9dd8-55fbddfc4c13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:48.506676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52bd2e34-5237-4749-9dd8-55fbddfc4c13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:48.507102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-52bd2e34-5237-4749-9dd8-55fbddfc4c13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:48.538649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-52bd2e34-5237-4749-9dd8-55fbddfc4c13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Jul 18 17:02:48.539209 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 563/1000] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:48 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:48.854246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e14294df-ce6b-4cc8-85ca-1ddb72b20ef3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:48.854879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e14294df-ce6b-4cc8-85ca-1ddb72b20ef3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:48.861611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e14294df-ce6b-4cc8-85ca-1ddb72b20ef3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:48.862064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e14294df-ce6b-4cc8-85ca-1ddb72b20ef3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:48.862834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e14294df-ce6b-4cc8-85ca-1ddb72b20ef3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:48.863271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e14294df-ce6b-4cc8-85ca-1ddb72b20ef3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:48.927351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e14294df-ce6b-4cc8-85ca-1ddb72b20ef3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:48.934973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e14294df-ce6b-4cc8-85ca-1ddb72b20ef3 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084646 Jul 18 17:02:48.935570 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 438/1001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:48 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:49.551266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5f8f0661-f8b4-4ee4-8a70-3f8731344eef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:49.552217 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5f8f0661-f8b4-4ee4-8a70-3f8731344eef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:49.558742 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5f8f0661-f8b4-4ee4-8a70-3f8731344eef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:49.559214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5f8f0661-f8b4-4ee4-8a70-3f8731344eef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:49.560008 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5f8f0661-f8b4-4ee4-8a70-3f8731344eef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:49.560443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5f8f0661-f8b4-4ee4-8a70-3f8731344eef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:49.589348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5f8f0661-f8b4-4ee4-8a70-3f8731344eef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042864 Jul 18 17:02:49.589890 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 564/1002] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:49 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:49.931950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:02:49.932567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:02:49.952868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-761fbf2d-45b7-4697-900d-cd2586d09cd7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:49.953972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-761fbf2d-45b7-4697-900d-cd2586d09cd7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:49.960669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-761fbf2d-45b7-4697-900d-cd2586d09cd7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:49.961140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-761fbf2d-45b7-4697-900d-cd2586d09cd7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:49.961884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-761fbf2d-45b7-4697-900d-cd2586d09cd7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:49.962311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-761fbf2d-45b7-4697-900d-cd2586d09cd7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:50.024160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-761fbf2d-45b7-4697-900d-cd2586d09cd7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:50.032720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-761fbf2d-45b7-4697-900d-cd2586d09cd7 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.082685 Jul 18 17:02:50.033324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 439/1003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:49 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:50.601183 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-816c1acd-00d7-4c91-86aa-27900a9086f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:50.602012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-816c1acd-00d7-4c91-86aa-27900a9086f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:50.603888 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:50.608576 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-816c1acd-00d7-4c91-86aa-27900a9086f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:50.609022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-816c1acd-00d7-4c91-86aa-27900a9086f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:50.610279 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-816c1acd-00d7-4c91-86aa-27900a9086f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:50.610780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-816c1acd-00d7-4c91-86aa-27900a9086f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:50.640006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-816c1acd-00d7-4c91-86aa-27900a9086f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042767 Jul 18 17:02:50.640547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 565/1004] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:50 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:51.049997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0f193151-a5b7-4c8d-9b2c-34bb77dbffec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:51.050605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0f193151-a5b7-4c8d-9b2c-34bb77dbffec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:51.057261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f193151-a5b7-4c8d-9b2c-34bb77dbffec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:51.057711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f193151-a5b7-4c8d-9b2c-34bb77dbffec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:51.058475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f193151-a5b7-4c8d-9b2c-34bb77dbffec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:51.058915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f193151-a5b7-4c8d-9b2c-34bb77dbffec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:51.120681 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0f193151-a5b7-4c8d-9b2c-34bb77dbffec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:51.128818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0f193151-a5b7-4c8d-9b2c-34bb77dbffec tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.083103 Jul 18 17:02:51.129372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 440/1005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:51 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:51.652319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c32d4067-532c-4033-9229-4ec49bbaef25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:51.653240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c32d4067-532c-4033-9229-4ec49bbaef25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:51.660126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c32d4067-532c-4033-9229-4ec49bbaef25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:51.660587 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c32d4067-532c-4033-9229-4ec49bbaef25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:51.661363 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c32d4067-532c-4033-9229-4ec49bbaef25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:51.661797 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c32d4067-532c-4033-9229-4ec49bbaef25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:51.692322 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c32d4067-532c-4033-9229-4ec49bbaef25 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 Jul 18 17:02:51.693018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 566/1006] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:51 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:52.145896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4014d3d3-4cbb-4d94-9393-6d504ab37b88 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:52.146479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4014d3d3-4cbb-4d94-9393-6d504ab37b88 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:52.153108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4014d3d3-4cbb-4d94-9393-6d504ab37b88 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:52.153551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4014d3d3-4cbb-4d94-9393-6d504ab37b88 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:52.154314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4014d3d3-4cbb-4d94-9393-6d504ab37b88 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:52.154748 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4014d3d3-4cbb-4d94-9393-6d504ab37b88 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:52.218871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4014d3d3-4cbb-4d94-9393-6d504ab37b88 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:52.227055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4014d3d3-4cbb-4d94-9393-6d504ab37b88 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085133 Jul 18 17:02:52.227643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 441/1007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:52 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:52.704678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-11c685a1-6934-4566-a2c2-ce3c07250ca9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:52.705633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-11c685a1-6934-4566-a2c2-ce3c07250ca9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:52.711901 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-11c685a1-6934-4566-a2c2-ce3c07250ca9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:52.712346 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-11c685a1-6934-4566-a2c2-ce3c07250ca9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:52.713098 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-11c685a1-6934-4566-a2c2-ce3c07250ca9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:52.713528 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-11c685a1-6934-4566-a2c2-ce3c07250ca9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:52.743238 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-11c685a1-6934-4566-a2c2-ce3c07250ca9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 Jul 18 17:02:52.743820 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 567/1008] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:52 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:02:53.243593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9a7fe4f2-da19-4312-9d4e-41abfd1050db tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:53.244181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9a7fe4f2-da19-4312-9d4e-41abfd1050db tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:53.246633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=64 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:53.252005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a7fe4f2-da19-4312-9d4e-41abfd1050db tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:53.252449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a7fe4f2-da19-4312-9d4e-41abfd1050db tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:53.253257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a7fe4f2-da19-4312-9d4e-41abfd1050db tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:53.253690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a7fe4f2-da19-4312-9d4e-41abfd1050db tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:53.315632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9a7fe4f2-da19-4312-9d4e-41abfd1050db tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:53.323063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9a7fe4f2-da19-4312-9d4e-41abfd1050db tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.083382 Jul 18 17:02:53.323645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 442/1009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:53 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:53.755650 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-38420239-bde0-4779-8285-849cc16c9602 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:53.756576 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-38420239-bde0-4779-8285-849cc16c9602 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:53.762709 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-38420239-bde0-4779-8285-849cc16c9602 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:53.763160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-38420239-bde0-4779-8285-849cc16c9602 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:53.763994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-38420239-bde0-4779-8285-849cc16c9602 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:53.764428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-38420239-bde0-4779-8285-849cc16c9602 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:53.793861 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-38420239-bde0-4779-8285-849cc16c9602 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 Jul 18 17:02:53.794404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 568/1010] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:53 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:54.341496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5c2fec8d-d181-4c5a-94a5-c4e9650be17c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:54.342112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5c2fec8d-d181-4c5a-94a5-c4e9650be17c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:54.349779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5c2fec8d-d181-4c5a-94a5-c4e9650be17c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:54.350227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5c2fec8d-d181-4c5a-94a5-c4e9650be17c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:54.351003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5c2fec8d-d181-4c5a-94a5-c4e9650be17c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:54.351446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5c2fec8d-d181-4c5a-94a5-c4e9650be17c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:54.413960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5c2fec8d-d181-4c5a-94a5-c4e9650be17c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:54.421543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5c2fec8d-d181-4c5a-94a5-c4e9650be17c tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084061 Jul 18 17:02:54.422567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 443/1011] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:54 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:54.806413 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1671fc57-f0ad-438b-88f3-69a09b443610 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:54.807466 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1671fc57-f0ad-438b-88f3-69a09b443610 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:54.813922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1671fc57-f0ad-438b-88f3-69a09b443610 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:54.818146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1671fc57-f0ad-438b-88f3-69a09b443610 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:54.818146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1671fc57-f0ad-438b-88f3-69a09b443610 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:54.818146 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1671fc57-f0ad-438b-88f3-69a09b443610 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:54.836255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:54.846428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1671fc57-f0ad-438b-88f3-69a09b443610 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Jul 18 17:02:54.847100 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 569/1012] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:54 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:55.438403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-639bbc42-c90b-45ef-889f-e2b123fce2ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:55.439044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-639bbc42-c90b-45ef-889f-e2b123fce2ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:55.445805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-639bbc42-c90b-45ef-889f-e2b123fce2ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:55.446252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-639bbc42-c90b-45ef-889f-e2b123fce2ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:55.447055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-639bbc42-c90b-45ef-889f-e2b123fce2ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:55.447476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-639bbc42-c90b-45ef-889f-e2b123fce2ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:55.513827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-639bbc42-c90b-45ef-889f-e2b123fce2ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:55.521802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-639bbc42-c90b-45ef-889f-e2b123fce2ba tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.087349 Jul 18 17:02:55.522362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 444/1013] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:55 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:55.858122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b9549537-5150-4ec4-9438-d3d074aca7a6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:55.859040 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b9549537-5150-4ec4-9438-d3d074aca7a6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:55.865932 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b9549537-5150-4ec4-9438-d3d074aca7a6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:55.866412 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b9549537-5150-4ec4-9438-d3d074aca7a6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:55.867233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b9549537-5150-4ec4-9438-d3d074aca7a6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:55.867595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b9549537-5150-4ec4-9438-d3d074aca7a6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:55.898904 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b9549537-5150-4ec4-9438-d3d074aca7a6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Jul 18 17:02:55.899462 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 570/1014] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:55 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:56.538981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-38727271-a955-43a2-98ff-7bd2953ffe64 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:56.539614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-38727271-a955-43a2-98ff-7bd2953ffe64 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:56.546432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-38727271-a955-43a2-98ff-7bd2953ffe64 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:56.546890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-38727271-a955-43a2-98ff-7bd2953ffe64 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:56.548177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-38727271-a955-43a2-98ff-7bd2953ffe64 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:56.548668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-38727271-a955-43a2-98ff-7bd2953ffe64 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:56.614738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-38727271-a955-43a2-98ff-7bd2953ffe64 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:56.623006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-38727271-a955-43a2-98ff-7bd2953ffe64 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.087900 Jul 18 17:02:56.623615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 445/1015] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:56 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:56.913180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-392708ad-753a-4804-8257-6051d142a360 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:56.914120 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-392708ad-753a-4804-8257-6051d142a360 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:56.921311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-392708ad-753a-4804-8257-6051d142a360 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:56.921753 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-392708ad-753a-4804-8257-6051d142a360 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:56.922562 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-392708ad-753a-4804-8257-6051d142a360 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:56.923251 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-392708ad-753a-4804-8257-6051d142a360 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:56.951996 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-392708ad-753a-4804-8257-6051d142a360 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 Jul 18 17:02:56.952541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 571/1016] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:56 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:57.640406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c5255245-b10a-43d3-baa7-b3a0e9d09220 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:57.641343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c5255245-b10a-43d3-baa7-b3a0e9d09220 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:57.648674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5255245-b10a-43d3-baa7-b3a0e9d09220 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:57.649145 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5255245-b10a-43d3-baa7-b3a0e9d09220 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:57.649914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5255245-b10a-43d3-baa7-b3a0e9d09220 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:57.650341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5255245-b10a-43d3-baa7-b3a0e9d09220 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:57.713308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c5255245-b10a-43d3-baa7-b3a0e9d09220 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:57.716785 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:57.721952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c5255245-b10a-43d3-baa7-b3a0e9d09220 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085402 Jul 18 17:02:57.727124 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 446/1017] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:57 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:02:57.964493 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-01c4df88-e59b-4b01-87bb-9d9f7a09d742 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:57.965350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-01c4df88-e59b-4b01-87bb-9d9f7a09d742 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:57.972061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-01c4df88-e59b-4b01-87bb-9d9f7a09d742 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:57.972523 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-01c4df88-e59b-4b01-87bb-9d9f7a09d742 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:57.973292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-01c4df88-e59b-4b01-87bb-9d9f7a09d742 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:57.973723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-01c4df88-e59b-4b01-87bb-9d9f7a09d742 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:58.004074 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-01c4df88-e59b-4b01-87bb-9d9f7a09d742 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043538 Jul 18 17:02:58.004640 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 572/1018] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:57 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:58.746764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2284e777-e9c1-421d-b4f5-11a9b8d45219 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:58.747374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2284e777-e9c1-421d-b4f5-11a9b8d45219 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:58.758381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2284e777-e9c1-421d-b4f5-11a9b8d45219 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:58.758830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2284e777-e9c1-421d-b4f5-11a9b8d45219 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:58.759640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2284e777-e9c1-421d-b4f5-11a9b8d45219 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:58.760086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2284e777-e9c1-421d-b4f5-11a9b8d45219 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:58.822817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2284e777-e9c1-421d-b4f5-11a9b8d45219 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:58.830505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2284e777-e9c1-421d-b4f5-11a9b8d45219 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.087644 Jul 18 17:02:58.831078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 447/1019] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:58 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:02:59.015076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-108f94fa-1f6e-4b90-abd3-9f8cee23d6ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:59.015961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-108f94fa-1f6e-4b90-abd3-9f8cee23d6ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:59.022005 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-108f94fa-1f6e-4b90-abd3-9f8cee23d6ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:59.022448 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-108f94fa-1f6e-4b90-abd3-9f8cee23d6ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:59.023277 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-108f94fa-1f6e-4b90-abd3-9f8cee23d6ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:59.023754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-108f94fa-1f6e-4b90-abd3-9f8cee23d6ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:59.054178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-108f94fa-1f6e-4b90-abd3-9f8cee23d6ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043021 Jul 18 17:02:59.054754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 573/1020] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:02:59 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:02:59.847693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a92bb609-cc8c-448b-b2ed-e281e4cd5aaa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:02:59.848305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a92bb609-cc8c-448b-b2ed-e281e4cd5aaa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:02:59.854834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a92bb609-cc8c-448b-b2ed-e281e4cd5aaa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:59.855287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a92bb609-cc8c-448b-b2ed-e281e4cd5aaa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:59.856082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a92bb609-cc8c-448b-b2ed-e281e4cd5aaa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:02:59.856518 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a92bb609-cc8c-448b-b2ed-e281e4cd5aaa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:02:59.919726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a92bb609-cc8c-448b-b2ed-e281e4cd5aaa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:02:59.927952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a92bb609-cc8c-448b-b2ed-e281e4cd5aaa tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.085269 Jul 18 17:02:59.928697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 448/1021] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:02:59 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:00.066132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3a18e58d-6f4f-4253-9b36-6124b25cca2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:00.067051 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3a18e58d-6f4f-4253-9b36-6124b25cca2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:00.073209 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a18e58d-6f4f-4253-9b36-6124b25cca2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:00.073649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a18e58d-6f4f-4253-9b36-6124b25cca2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:00.074397 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a18e58d-6f4f-4253-9b36-6124b25cca2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:00.074821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3a18e58d-6f4f-4253-9b36-6124b25cca2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:00.105781 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3a18e58d-6f4f-4253-9b36-6124b25cca2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Jul 18 17:03:00.106236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 574/1022] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:00 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:00.944943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-17fcc6f9-f28a-40c6-ad9b-df0de5e68b12 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:00.945557 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-17fcc6f9-f28a-40c6-ad9b-df0de5e68b12 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:00.952374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17fcc6f9-f28a-40c6-ad9b-df0de5e68b12 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:00.952820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17fcc6f9-f28a-40c6-ad9b-df0de5e68b12 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:00.953633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17fcc6f9-f28a-40c6-ad9b-df0de5e68b12 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:00.954185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17fcc6f9-f28a-40c6-ad9b-df0de5e68b12 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.018334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-17fcc6f9-f28a-40c6-ad9b-df0de5e68b12 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:01.025981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-17fcc6f9-f28a-40c6-ad9b-df0de5e68b12 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084965 Jul 18 17:03:01.026549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 449/1023] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:00 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:01.117343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c8ea72f4-6c12-4636-a941-7669ddb867c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:01.118180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c8ea72f4-6c12-4636-a941-7669ddb867c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:01.124406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8ea72f4-6c12-4636-a941-7669ddb867c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.124857 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8ea72f4-6c12-4636-a941-7669ddb867c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.126041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8ea72f4-6c12-4636-a941-7669ddb867c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:01.126481 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8ea72f4-6c12-4636-a941-7669ddb867c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:01.158269 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c8ea72f4-6c12-4636-a941-7669ddb867c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044886 Jul 18 17:03:01.158839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 575/1024] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:01 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:02.043177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3c6648ed-eb5f-41f8-8158-e20d43c2f66a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:02.043751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3c6648ed-eb5f-41f8-8158-e20d43c2f66a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:02.051052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c6648ed-eb5f-41f8-8158-e20d43c2f66a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:02.051515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c6648ed-eb5f-41f8-8158-e20d43c2f66a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:02.052267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c6648ed-eb5f-41f8-8158-e20d43c2f66a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:02.052699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c6648ed-eb5f-41f8-8158-e20d43c2f66a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:02.115343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3c6648ed-eb5f-41f8-8158-e20d43c2f66a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:02.122986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3c6648ed-eb5f-41f8-8158-e20d43c2f66a tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.083760 Jul 18 17:03:02.123582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 450/1025] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:02 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:02.170038 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6d0d7671-774c-4141-8b5a-18b1ef3f0e77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:02.170963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6d0d7671-774c-4141-8b5a-18b1ef3f0e77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:02.178077 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6d0d7671-774c-4141-8b5a-18b1ef3f0e77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:02.178521 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6d0d7671-774c-4141-8b5a-18b1ef3f0e77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:02.179348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6d0d7671-774c-4141-8b5a-18b1ef3f0e77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:02.179817 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6d0d7671-774c-4141-8b5a-18b1ef3f0e77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:02.209477 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6d0d7671-774c-4141-8b5a-18b1ef3f0e77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043413 Jul 18 17:03:02.210041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 576/1026] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:02 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:03.140143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-85edac39-ec9d-4d77-b4a9-ee720a9bf7be tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:03.140781 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-85edac39-ec9d-4d77-b4a9-ee720a9bf7be tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:03.147655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85edac39-ec9d-4d77-b4a9-ee720a9bf7be tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:03.148104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85edac39-ec9d-4d77-b4a9-ee720a9bf7be tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:03.148859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85edac39-ec9d-4d77-b4a9-ee720a9bf7be tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:03.149294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85edac39-ec9d-4d77-b4a9-ee720a9bf7be tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:03.214376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-85edac39-ec9d-4d77-b4a9-ee720a9bf7be tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:03.220384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-85edac39-ec9d-4d77-b4a9-ee720a9bf7be tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.084070 Jul 18 17:03:03.220959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 451/1027] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:03 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:03:03.223745 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9536c1ad-152a-4d58-8e2f-bfdaa7dd3cff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:03.224674 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9536c1ad-152a-4d58-8e2f-bfdaa7dd3cff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:03.230975 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9536c1ad-152a-4d58-8e2f-bfdaa7dd3cff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:03.231440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9536c1ad-152a-4d58-8e2f-bfdaa7dd3cff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:03.232229 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9536c1ad-152a-4d58-8e2f-bfdaa7dd3cff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:03.232666 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9536c1ad-152a-4d58-8e2f-bfdaa7dd3cff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:03.262772 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9536c1ad-152a-4d58-8e2f-bfdaa7dd3cff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Jul 18 17:03:03.263311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 577/1028] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:03 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:03:03.832149 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:03:03.832429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:03:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:03:04.238245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0e0567d4-0a41-4829-bcc8-2e500b9a8281 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:04.239310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0e0567d4-0a41-4829-bcc8-2e500b9a8281 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:04.245867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e0567d4-0a41-4829-bcc8-2e500b9a8281 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:04.246293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e0567d4-0a41-4829-bcc8-2e500b9a8281 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:04.247058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e0567d4-0a41-4829-bcc8-2e500b9a8281 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:04.247481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e0567d4-0a41-4829-bcc8-2e500b9a8281 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:04.274470 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4e8f0f12-fe88-4d4b-934d-967b1c413f8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:04.275595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4e8f0f12-fe88-4d4b-934d-967b1c413f8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:04.282067 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4e8f0f12-fe88-4d4b-934d-967b1c413f8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:04.282559 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4e8f0f12-fe88-4d4b-934d-967b1c413f8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:04.283441 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4e8f0f12-fe88-4d4b-934d-967b1c413f8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:04.283967 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4e8f0f12-fe88-4d4b-934d-967b1c413f8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:04.312486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0e0567d4-0a41-4829-bcc8-2e500b9a8281 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:04.315961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4e8f0f12-fe88-4d4b-934d-967b1c413f8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 Jul 18 17:03:04.316531 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 578/1029] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:04 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:03:04.321319 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0e0567d4-0a41-4829-bcc8-2e500b9a8281 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.088364 Jul 18 17:03:04.321862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 452/1030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:04 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:05.327966 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-442a6206-5333-47af-8cac-81c804309dbe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:05.329488 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-442a6206-5333-47af-8cac-81c804309dbe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:05.335897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-442a6206-5333-47af-8cac-81c804309dbe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.336337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-442a6206-5333-47af-8cac-81c804309dbe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.337110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-442a6206-5333-47af-8cac-81c804309dbe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.337543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-442a6206-5333-47af-8cac-81c804309dbe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.338540 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-74b1bad7-3de3-4762-9bf9-04df2ec1e0ae tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:05.339165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-74b1bad7-3de3-4762-9bf9-04df2ec1e0ae tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:05.346757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-74b1bad7-3de3-4762-9bf9-04df2ec1e0ae tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.347213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-74b1bad7-3de3-4762-9bf9-04df2ec1e0ae tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.348125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-74b1bad7-3de3-4762-9bf9-04df2ec1e0ae tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:05.348566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-74b1bad7-3de3-4762-9bf9-04df2ec1e0ae tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:05.369900 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-442a6206-5333-47af-8cac-81c804309dbe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045994 Jul 18 17:03:05.370473 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 579/1031] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:05 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:05.423903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-74b1bad7-3de3-4762-9bf9-04df2ec1e0ae tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:05.431892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-74b1bad7-3de3-4762-9bf9-04df2ec1e0ae tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.097110 Jul 18 17:03:05.432489 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 453/1032] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:05 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:03:06.381973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9f7a0511-c8b9-40d5-b2ac-64eeaa80bf06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:06.382887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9f7a0511-c8b9-40d5-b2ac-64eeaa80bf06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:06.389253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9f7a0511-c8b9-40d5-b2ac-64eeaa80bf06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:06.389703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9f7a0511-c8b9-40d5-b2ac-64eeaa80bf06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:06.390496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9f7a0511-c8b9-40d5-b2ac-64eeaa80bf06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:06.391076 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9f7a0511-c8b9-40d5-b2ac-64eeaa80bf06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:06.421188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9f7a0511-c8b9-40d5-b2ac-64eeaa80bf06 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043083 Jul 18 17:03:06.421730 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 580/1033] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:06 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:06.450428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c69d2b64-7b0a-4f80-82c5-b8d92bd340af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:06.451186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c69d2b64-7b0a-4f80-82c5-b8d92bd340af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:06.458568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c69d2b64-7b0a-4f80-82c5-b8d92bd340af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:06.459020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c69d2b64-7b0a-4f80-82c5-b8d92bd340af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:06.459888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c69d2b64-7b0a-4f80-82c5-b8d92bd340af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:06.460329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c69d2b64-7b0a-4f80-82c5-b8d92bd340af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:06.527948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c69d2b64-7b0a-4f80-82c5-b8d92bd340af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:06.535913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c69d2b64-7b0a-4f80-82c5-b8d92bd340af tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.089463 Jul 18 17:03:06.536499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 454/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:06 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:07.433382 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c22d99f9-166d-4126-9e72-eb7d2e22c227 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:07.434297 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c22d99f9-166d-4126-9e72-eb7d2e22c227 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:07.440902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c22d99f9-166d-4126-9e72-eb7d2e22c227 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:07.441348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c22d99f9-166d-4126-9e72-eb7d2e22c227 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:07.442106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c22d99f9-166d-4126-9e72-eb7d2e22c227 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:07.442547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c22d99f9-166d-4126-9e72-eb7d2e22c227 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:07.471757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c22d99f9-166d-4126-9e72-eb7d2e22c227 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042270 Jul 18 17:03:07.472323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 581/1035] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:07 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:07.553284 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-67675829-af31-4b12-8968-88fcd98391b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:07.553823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-67675829-af31-4b12-8968-88fcd98391b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:07.560467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67675829-af31-4b12-8968-88fcd98391b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:07.560912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67675829-af31-4b12-8968-88fcd98391b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:07.561664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67675829-af31-4b12-8968-88fcd98391b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:07.562099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67675829-af31-4b12-8968-88fcd98391b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:07.624424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-67675829-af31-4b12-8968-88fcd98391b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:07.632645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-67675829-af31-4b12-8968-88fcd98391b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.083264 Jul 18 17:03:07.633203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 455/1036] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:07 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:08.483715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f541e803-a347-4769-83e2-38a923a17da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:08.484627 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f541e803-a347-4769-83e2-38a923a17da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:08.492538 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f541e803-a347-4769-83e2-38a923a17da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:08.492971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f541e803-a347-4769-83e2-38a923a17da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:08.493741 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f541e803-a347-4769-83e2-38a923a17da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:08.494172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f541e803-a347-4769-83e2-38a923a17da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:08.528205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f541e803-a347-4769-83e2-38a923a17da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046068 Jul 18 17:03:08.528205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 582/1037] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:08 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:08.652229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b305ef4a-96a6-4561-9e9e-27b435002d07 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:08.653327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b305ef4a-96a6-4561-9e9e-27b435002d07 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:08.662374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b305ef4a-96a6-4561-9e9e-27b435002d07 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:08.662832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b305ef4a-96a6-4561-9e9e-27b435002d07 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:08.663666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b305ef4a-96a6-4561-9e9e-27b435002d07 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:08.664130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b305ef4a-96a6-4561-9e9e-27b435002d07 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:08.729022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b305ef4a-96a6-4561-9e9e-27b435002d07 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:08.737172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b305ef4a-96a6-4561-9e9e-27b435002d07 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.090403 Jul 18 17:03:08.737668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 456/1038] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:08 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:09.538955 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-983c71f8-cfe0-4319-9b04-d2e6ed4d38b8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:09.539903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-983c71f8-cfe0-4319-9b04-d2e6ed4d38b8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:09.545960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-983c71f8-cfe0-4319-9b04-d2e6ed4d38b8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:09.546404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-983c71f8-cfe0-4319-9b04-d2e6ed4d38b8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:09.547394 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-983c71f8-cfe0-4319-9b04-d2e6ed4d38b8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:09.548940 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-983c71f8-cfe0-4319-9b04-d2e6ed4d38b8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:09.579187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-983c71f8-cfe0-4319-9b04-d2e6ed4d38b8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Jul 18 17:03:09.579777 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 583/1039] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:09 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:09.754016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fa94418c-d0dd-4d3f-b8c2-b3527ded71b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:09.754609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fa94418c-d0dd-4d3f-b8c2-b3527ded71b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:09.761083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa94418c-d0dd-4d3f-b8c2-b3527ded71b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:09.761538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa94418c-d0dd-4d3f-b8c2-b3527ded71b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:09.762288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa94418c-d0dd-4d3f-b8c2-b3527ded71b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:09.762717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa94418c-d0dd-4d3f-b8c2-b3527ded71b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:09.827365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fa94418c-d0dd-4d3f-b8c2-b3527ded71b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:09.838985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fa94418c-d0dd-4d3f-b8c2-b3527ded71b2 tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.088531 Jul 18 17:03:09.841355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 457/1040] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:09 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:10.591108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8e7a7cf7-96e3-4c35-bb4d-635763a81cde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:10.592081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8e7a7cf7-96e3-4c35-bb4d-635763a81cde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:10.598299 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e7a7cf7-96e3-4c35-bb4d-635763a81cde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:10.598745 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e7a7cf7-96e3-4c35-bb4d-635763a81cde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:10.599528 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e7a7cf7-96e3-4c35-bb4d-635763a81cde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:10.599967 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e7a7cf7-96e3-4c35-bb4d-635763a81cde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:10.630404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8e7a7cf7-96e3-4c35-bb4d-635763a81cde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Jul 18 17:03:10.630966 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 584/1041] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:10 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:10.856756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fe462679-1792-47d7-a999-0a3ab59e6a3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:10.857313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fe462679-1792-47d7-a999-0a3ab59e6a3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] [instance: 6f1c9245-f7e5-4ff8-b561-7dc29e139931] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:10.865168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe462679-1792-47d7-a999-0a3ab59e6a3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:10.865618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe462679-1792-47d7-a999-0a3ab59e6a3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:10.866384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe462679-1792-47d7-a999-0a3ab59e6a3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:10.866826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe462679-1792-47d7-a999-0a3ab59e6a3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:10.932410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe462679-1792-47d7-a999-0a3ab59e6a3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6472100830a54d6a8e21ee55b68e6a02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d70fe1437fc423681962ee747f07410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:03:10.940020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fe462679-1792-47d7-a999-0a3ab59e6a3e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931" status: 200 len: 1213 microversion: 2.1 time: 0.087114 Jul 18 17:03:10.940593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 458/1042] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:03:10 2022] GET /compute/v2.1/servers/6f1c9245-f7e5-4ff8-b561-7dc29e139931 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:03:11.186779 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9e0127c6-2526-49ac-b068-e5c09768ca8e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] Calling method '.version_select at 0x7fd6ae0018b0>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:11.280726 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9e0127c6-2526-49ac-b068-e5c09768ca8e tempest-TestShelveInstance-1202544703 tempest-TestShelveInstance-1202544703-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305916691" status: 202 len: 0 microversion: 2.1 time: 0.097783 Jul 18 17:03:11.281584 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 585/1043] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jul 18 17:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-305916691 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:03:11.642828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-11d81e19-eb93-481a-b34a-e01f07a78f17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:11.643903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-11d81e19-eb93-481a-b34a-e01f07a78f17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:11.650245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11d81e19-eb93-481a-b34a-e01f07a78f17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:11.650696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11d81e19-eb93-481a-b34a-e01f07a78f17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:11.651472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11d81e19-eb93-481a-b34a-e01f07a78f17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:11.651959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11d81e19-eb93-481a-b34a-e01f07a78f17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:11.684169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-11d81e19-eb93-481a-b34a-e01f07a78f17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Jul 18 17:03:11.684671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 459/1044] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:11 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:12.696165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-59ba5708-f550-45a6-9a7f-62c80d3173ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:12.697437 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-59ba5708-f550-45a6-9a7f-62c80d3173ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:12.703841 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-59ba5708-f550-45a6-9a7f-62c80d3173ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:12.704760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-59ba5708-f550-45a6-9a7f-62c80d3173ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:12.705913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-59ba5708-f550-45a6-9a7f-62c80d3173ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:12.706419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-59ba5708-f550-45a6-9a7f-62c80d3173ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:12.740185 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-59ba5708-f550-45a6-9a7f-62c80d3173ab tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048967 Jul 18 17:03:12.740805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 586/1045] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:12 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:03:13.752053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d0374f5f-4662-4243-a75c-6f83ce4a9d86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:13.753675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d0374f5f-4662-4243-a75c-6f83ce4a9d86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:13.760313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d0374f5f-4662-4243-a75c-6f83ce4a9d86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:13.761131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d0374f5f-4662-4243-a75c-6f83ce4a9d86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:13.762187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d0374f5f-4662-4243-a75c-6f83ce4a9d86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:13.762620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d0374f5f-4662-4243-a75c-6f83ce4a9d86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:13.802396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d0374f5f-4662-4243-a75c-6f83ce4a9d86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054637 Jul 18 17:03:13.803741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 460/1046] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:13 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:14.820311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e067b906-9ece-404c-a1e8-d6c1fb94eeaa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:14.822046 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e067b906-9ece-404c-a1e8-d6c1fb94eeaa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:14.842836 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e067b906-9ece-404c-a1e8-d6c1fb94eeaa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:14.848780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e067b906-9ece-404c-a1e8-d6c1fb94eeaa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:14.848780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e067b906-9ece-404c-a1e8-d6c1fb94eeaa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:14.848780 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e067b906-9ece-404c-a1e8-d6c1fb94eeaa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:14.851521 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:14.893401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e067b906-9ece-404c-a1e8-d6c1fb94eeaa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080323 Jul 18 17:03:14.894996 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 587/1047] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:14 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:15.906274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-db387c54-2485-432f-8ac7-ec287733be8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:15.908884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-db387c54-2485-432f-8ac7-ec287733be8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:15.918706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db387c54-2485-432f-8ac7-ec287733be8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:15.919167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db387c54-2485-432f-8ac7-ec287733be8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:15.919997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db387c54-2485-432f-8ac7-ec287733be8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:15.920435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db387c54-2485-432f-8ac7-ec287733be8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:15.978390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-db387c54-2485-432f-8ac7-ec287733be8d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076274 Jul 18 17:03:15.978981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 461/1048] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:15 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:16.992632 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-451c8aeb-5776-4c76-aae5-9615692ba13e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:16.993574 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-451c8aeb-5776-4c76-aae5-9615692ba13e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:17.003701 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-451c8aeb-5776-4c76-aae5-9615692ba13e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:17.004345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-451c8aeb-5776-4c76-aae5-9615692ba13e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:17.005254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-451c8aeb-5776-4c76-aae5-9615692ba13e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:17.005840 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-451c8aeb-5776-4c76-aae5-9615692ba13e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:17.041567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-451c8aeb-5776-4c76-aae5-9615692ba13e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052799 Jul 18 17:03:17.042242 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 588/1049] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:16 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:18.053927 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-33aeb573-eeba-477e-bb64-040c8dd35320 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:18.054853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-33aeb573-eeba-477e-bb64-040c8dd35320 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:18.061744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33aeb573-eeba-477e-bb64-040c8dd35320 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:18.062179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33aeb573-eeba-477e-bb64-040c8dd35320 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:18.062954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33aeb573-eeba-477e-bb64-040c8dd35320 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:18.064143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33aeb573-eeba-477e-bb64-040c8dd35320 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:18.094157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-33aeb573-eeba-477e-bb64-040c8dd35320 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Jul 18 17:03:18.095136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 462/1050] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:18 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:19.106102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d1254a3a-3514-450b-bf22-c7e9933b3a5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:03:19.107028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d1254a3a-3514-450b-bf22-c7e9933b3a5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:19.113353 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1254a3a-3514-450b-bf22-c7e9933b3a5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:19.113722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1254a3a-3514-450b-bf22-c7e9933b3a5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:19.114482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1254a3a-3514-450b-bf22-c7e9933b3a5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:19.115099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d1254a3a-3514-450b-bf22-c7e9933b3a5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:19.145746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d1254a3a-3514-450b-bf22-c7e9933b3a5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043459 Jul 18 17:03:19.146226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 589/1051] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:03:19 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:03:20.156738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b5196cf2-d0b3-429e-827f-4158dc154427 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:03:20.158185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b5196cf2-d0b3-429e-827f-4158dc154427 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:03:20.164792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b5196cf2-d0b3-429e-827f-4158dc154427 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:20.165233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b5196cf2-d0b3-429e-827f-4158dc154427 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:20.165991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b5196cf2-d0b3-429e-827f-4158dc154427 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:03:20.166417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b5196cf2-d0b3-429e-827f-4158dc154427 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:03:20.185276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:20.248663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b5196cf2-d0b3-429e-827f-4158dc154427 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/action" status: 200 len: 76222 microversion: 2.1 time: 0.095522 Jul 18 17:03:20.249731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 463/1052] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 17:03:20 2022] POST /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5/action => generated 76222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 17:03:45.848267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:03:45.849001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:04:14.336776 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:04:14.337371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:04:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:06:06.539507 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:06:06.540220 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:06:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:06:09.940121 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:06:09.948868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:06:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:06:10.273844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:06:10.274071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:06:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:06:23.845468 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:06:23.846008 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:06:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:07:05.860860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:07:05.861443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:07:34.345336 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:07:34.345982 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:07:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:08:31.005435 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:31.006605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=16 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:31.011210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-307355fb-0746-40b0-ae04-886f021ee9ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:31.011811 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-307355fb-0746-40b0-ae04-886f021ee9ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:31.018777 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-307355fb-0746-40b0-ae04-886f021ee9ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:31.019271 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-307355fb-0746-40b0-ae04-886f021ee9ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:31.026610 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-307355fb-0746-40b0-ae04-886f021ee9ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:31.026610 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-307355fb-0746-40b0-ae04-886f021ee9ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:31.046102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-307355fb-0746-40b0-ae04-886f021ee9ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Going to try to terminate instance {{(pid=124945) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:08:31.356672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-307355fb-0746-40b0-ae04-886f021ee9ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 204 len: 0 microversion: 2.1 time: 0.352670 Jul 18 17:08:31.357245 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 590/1053] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:08:31 2022] DELETE /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:08:31.364123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [338713e3-faee-430e-bab6-06d24b6ec401] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 17:08:31.365580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=43 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:31.368924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-586ac85a-3fd4-4243-b71c-85a0917eeba7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:31.369785 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-586ac85a-3fd4-4243-b71c-85a0917eeba7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:31.377180 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-586ac85a-3fd4-4243-b71c-85a0917eeba7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:31.377626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-586ac85a-3fd4-4243-b71c-85a0917eeba7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:31.378459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-586ac85a-3fd4-4243-b71c-85a0917eeba7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:31.378902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-586ac85a-3fd4-4243-b71c-85a0917eeba7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:31.700380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-586ac85a-3fd4-4243-b71c-85a0917eeba7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:31.708466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-586ac85a-3fd4-4243-b71c-85a0917eeba7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.346826 Jul 18 17:08:31.709015 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 464/1054] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:31 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:32.726472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-24c276f0-a834-4e90-b36c-bd99e1a71df1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:32.727081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-24c276f0-a834-4e90-b36c-bd99e1a71df1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:32.733320 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-24c276f0-a834-4e90-b36c-bd99e1a71df1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:32.733765 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-24c276f0-a834-4e90-b36c-bd99e1a71df1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:32.734520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-24c276f0-a834-4e90-b36c-bd99e1a71df1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:32.734954 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-24c276f0-a834-4e90-b36c-bd99e1a71df1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:32.929059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-24c276f0-a834-4e90-b36c-bd99e1a71df1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:32.937507 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-24c276f0-a834-4e90-b36c-bd99e1a71df1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.215368 Jul 18 17:08:32.938068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 591/1055] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:32 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:33.954382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a6b3d7a2-b2d8-472a-8f1d-506ce1b0632f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:33.955014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a6b3d7a2-b2d8-472a-8f1d-506ce1b0632f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:33.962432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a6b3d7a2-b2d8-472a-8f1d-506ce1b0632f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:33.963552 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a6b3d7a2-b2d8-472a-8f1d-506ce1b0632f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:33.964345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a6b3d7a2-b2d8-472a-8f1d-506ce1b0632f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:33.964783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a6b3d7a2-b2d8-472a-8f1d-506ce1b0632f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:33.982114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] [338713e3-faee-430e-bab6-06d24b6ec401] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 59154. Jul 18 17:08:34.099020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a6b3d7a2-b2d8-472a-8f1d-506ce1b0632f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:34.108022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a6b3d7a2-b2d8-472a-8f1d-506ce1b0632f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157452 Jul 18 17:08:34.108581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 465/1056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:33 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:35.126412 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c8992f4a-c720-487f-a6ae-87af300172c7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:35.126961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c8992f4a-c720-487f-a6ae-87af300172c7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:35.133319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8992f4a-c720-487f-a6ae-87af300172c7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:35.133770 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8992f4a-c720-487f-a6ae-87af300172c7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:35.134541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8992f4a-c720-487f-a6ae-87af300172c7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:35.135550 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c8992f4a-c720-487f-a6ae-87af300172c7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:35.287274 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c8992f4a-c720-487f-a6ae-87af300172c7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:35.296349 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c8992f4a-c720-487f-a6ae-87af300172c7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.174412 Jul 18 17:08:35.297122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 592/1057] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:35 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:36.315444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b2aebcef-e6a6-4c08-aece-d5fb8970eb48 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:36.316096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b2aebcef-e6a6-4c08-aece-d5fb8970eb48 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:36.323018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2aebcef-e6a6-4c08-aece-d5fb8970eb48 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:36.323466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2aebcef-e6a6-4c08-aece-d5fb8970eb48 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:36.324272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2aebcef-e6a6-4c08-aece-d5fb8970eb48 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:36.324711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2aebcef-e6a6-4c08-aece-d5fb8970eb48 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:36.470771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b2aebcef-e6a6-4c08-aece-d5fb8970eb48 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:36.480163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b2aebcef-e6a6-4c08-aece-d5fb8970eb48 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.170595 Jul 18 17:08:36.480827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 466/1058] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:36 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:37.498313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-23e9dd9d-1d66-4ec2-bd88-3c052268c044 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:37.498915 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-23e9dd9d-1d66-4ec2-bd88-3c052268c044 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:37.505412 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23e9dd9d-1d66-4ec2-bd88-3c052268c044 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:37.505890 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23e9dd9d-1d66-4ec2-bd88-3c052268c044 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:37.506628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23e9dd9d-1d66-4ec2-bd88-3c052268c044 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:37.507056 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-23e9dd9d-1d66-4ec2-bd88-3c052268c044 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:37.639876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-23e9dd9d-1d66-4ec2-bd88-3c052268c044 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:37.647837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-23e9dd9d-1d66-4ec2-bd88-3c052268c044 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153422 Jul 18 17:08:37.648408 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 593/1059] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:37 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:38.666307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cf6f7d9a-28b2-4ed1-95a1-65f2f234ee22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:38.666899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cf6f7d9a-28b2-4ed1-95a1-65f2f234ee22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:38.675156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cf6f7d9a-28b2-4ed1-95a1-65f2f234ee22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:38.676021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cf6f7d9a-28b2-4ed1-95a1-65f2f234ee22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:38.676859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cf6f7d9a-28b2-4ed1-95a1-65f2f234ee22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:38.677298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cf6f7d9a-28b2-4ed1-95a1-65f2f234ee22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:38.816694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cf6f7d9a-28b2-4ed1-95a1-65f2f234ee22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:38.825485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cf6f7d9a-28b2-4ed1-95a1-65f2f234ee22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.163701 Jul 18 17:08:38.826044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 467/1060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:38 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:39.843348 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-878576d3-0dcc-4ae1-a5c3-100b473c07cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:39.844110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-878576d3-0dcc-4ae1-a5c3-100b473c07cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:39.849899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-878576d3-0dcc-4ae1-a5c3-100b473c07cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:39.850335 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-878576d3-0dcc-4ae1-a5c3-100b473c07cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:39.851121 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-878576d3-0dcc-4ae1-a5c3-100b473c07cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:39.851569 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-878576d3-0dcc-4ae1-a5c3-100b473c07cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:39.982397 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-878576d3-0dcc-4ae1-a5c3-100b473c07cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:39.990425 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-878576d3-0dcc-4ae1-a5c3-100b473c07cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151100 Jul 18 17:08:39.990989 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 594/1061] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:39 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:41.008365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-189f7e9b-69dc-43c0-9378-d619f546dae1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:41.008967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-189f7e9b-69dc-43c0-9378-d619f546dae1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:41.016031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-189f7e9b-69dc-43c0-9378-d619f546dae1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:41.016537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-189f7e9b-69dc-43c0-9378-d619f546dae1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:41.017338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-189f7e9b-69dc-43c0-9378-d619f546dae1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:41.017745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-189f7e9b-69dc-43c0-9378-d619f546dae1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:41.154466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-189f7e9b-69dc-43c0-9378-d619f546dae1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:41.162468 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-189f7e9b-69dc-43c0-9378-d619f546dae1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.158032 Jul 18 17:08:41.163022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 468/1062] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:41 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:42.179907 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e4723780-14de-4786-8c87-177371613142 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:42.180472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e4723780-14de-4786-8c87-177371613142 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:42.187074 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e4723780-14de-4786-8c87-177371613142 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:42.187533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e4723780-14de-4786-8c87-177371613142 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:42.188278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e4723780-14de-4786-8c87-177371613142 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:42.188702 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e4723780-14de-4786-8c87-177371613142 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:42.317481 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e4723780-14de-4786-8c87-177371613142 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:42.326986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e4723780-14de-4786-8c87-177371613142 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151163 Jul 18 17:08:42.327583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 595/1063] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:42 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:43.343694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5b135be1-2066-432e-aae9-f0b2bc4c30cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:43.344318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5b135be1-2066-432e-aae9-f0b2bc4c30cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:43.350835 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b135be1-2066-432e-aae9-f0b2bc4c30cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:43.351276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b135be1-2066-432e-aae9-f0b2bc4c30cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:43.352062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b135be1-2066-432e-aae9-f0b2bc4c30cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:43.352490 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b135be1-2066-432e-aae9-f0b2bc4c30cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:43.481913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5b135be1-2066-432e-aae9-f0b2bc4c30cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:43.489888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5b135be1-2066-432e-aae9-f0b2bc4c30cb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150114 Jul 18 17:08:43.490454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 469/1064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:43 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:44.507641 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3f661bda-6445-4dbf-a747-e0d9d90139f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:44.508519 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3f661bda-6445-4dbf-a747-e0d9d90139f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:44.515249 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f661bda-6445-4dbf-a747-e0d9d90139f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:44.515788 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f661bda-6445-4dbf-a747-e0d9d90139f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:44.516547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f661bda-6445-4dbf-a747-e0d9d90139f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:44.517034 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f661bda-6445-4dbf-a747-e0d9d90139f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:44.655687 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3f661bda-6445-4dbf-a747-e0d9d90139f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:44.665140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3f661bda-6445-4dbf-a747-e0d9d90139f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.161294 Jul 18 17:08:44.665910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 596/1065] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:44 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:45.682908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0c026050-2e42-430f-9c9e-c070eb503cdb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:45.683529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0c026050-2e42-430f-9c9e-c070eb503cdb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:45.690226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c026050-2e42-430f-9c9e-c070eb503cdb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:45.690781 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c026050-2e42-430f-9c9e-c070eb503cdb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:45.691577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c026050-2e42-430f-9c9e-c070eb503cdb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:45.692019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c026050-2e42-430f-9c9e-c070eb503cdb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:45.835901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0c026050-2e42-430f-9c9e-c070eb503cdb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:45.844079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0c026050-2e42-430f-9c9e-c070eb503cdb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.165397 Jul 18 17:08:45.844992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 470/1066] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:45 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:46.863738 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-27308ae8-c30a-4194-af73-b0ef9cda5f59 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:46.864328 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-27308ae8-c30a-4194-af73-b0ef9cda5f59 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:46.870485 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-27308ae8-c30a-4194-af73-b0ef9cda5f59 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:46.870927 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-27308ae8-c30a-4194-af73-b0ef9cda5f59 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:46.871726 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-27308ae8-c30a-4194-af73-b0ef9cda5f59 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:46.872158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-27308ae8-c30a-4194-af73-b0ef9cda5f59 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:47.012459 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-27308ae8-c30a-4194-af73-b0ef9cda5f59 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:47.020467 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-27308ae8-c30a-4194-af73-b0ef9cda5f59 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.160610 Jul 18 17:08:47.021028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 597/1067] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:46 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:48.038593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-806f9104-fce4-4bde-9862-b3753fdc8865 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:48.039190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-806f9104-fce4-4bde-9862-b3753fdc8865 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:48.046367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-806f9104-fce4-4bde-9862-b3753fdc8865 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:48.046809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-806f9104-fce4-4bde-9862-b3753fdc8865 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:48.047587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-806f9104-fce4-4bde-9862-b3753fdc8865 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:48.048015 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-806f9104-fce4-4bde-9862-b3753fdc8865 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:48.182803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-806f9104-fce4-4bde-9862-b3753fdc8865 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:48.191097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-806f9104-fce4-4bde-9862-b3753fdc8865 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156355 Jul 18 17:08:48.191687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 471/1068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:48 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:49.208240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c407243e-3cd0-4ba9-90ac-9300d4e2eb73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:49.208841 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c407243e-3cd0-4ba9-90ac-9300d4e2eb73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:49.215431 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c407243e-3cd0-4ba9-90ac-9300d4e2eb73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:49.215919 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c407243e-3cd0-4ba9-90ac-9300d4e2eb73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:49.216669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c407243e-3cd0-4ba9-90ac-9300d4e2eb73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:49.217094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c407243e-3cd0-4ba9-90ac-9300d4e2eb73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:49.351932 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c407243e-3cd0-4ba9-90ac-9300d4e2eb73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:49.360152 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c407243e-3cd0-4ba9-90ac-9300d4e2eb73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155679 Jul 18 17:08:49.360801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 598/1069] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:49 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:50.377598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c25ca02b-5078-42bc-97d5-456e3c2a4f34 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:50.378157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c25ca02b-5078-42bc-97d5-456e3c2a4f34 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:50.385907 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c25ca02b-5078-42bc-97d5-456e3c2a4f34 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:50.386376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c25ca02b-5078-42bc-97d5-456e3c2a4f34 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:50.387290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c25ca02b-5078-42bc-97d5-456e3c2a4f34 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:50.387764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c25ca02b-5078-42bc-97d5-456e3c2a4f34 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:50.518765 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c25ca02b-5078-42bc-97d5-456e3c2a4f34 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:50.526926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c25ca02b-5078-42bc-97d5-456e3c2a4f34 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153707 Jul 18 17:08:50.527476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 472/1070] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:50 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:51.543326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d4fef350-50d6-4a8e-a08b-423306417784 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:51.543957 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d4fef350-50d6-4a8e-a08b-423306417784 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:51.549873 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d4fef350-50d6-4a8e-a08b-423306417784 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:51.550310 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d4fef350-50d6-4a8e-a08b-423306417784 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:51.551051 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d4fef350-50d6-4a8e-a08b-423306417784 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:51.551480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d4fef350-50d6-4a8e-a08b-423306417784 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:51.684958 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d4fef350-50d6-4a8e-a08b-423306417784 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:51.692905 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d4fef350-50d6-4a8e-a08b-423306417784 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153652 Jul 18 17:08:51.693463 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 599/1071] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:51 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:52.710400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4badc9f4-8a31-401d-8d82-b2ca7d5e58ea tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:52.711000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4badc9f4-8a31-401d-8d82-b2ca7d5e58ea tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:52.717688 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4badc9f4-8a31-401d-8d82-b2ca7d5e58ea tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:52.718137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4badc9f4-8a31-401d-8d82-b2ca7d5e58ea tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:52.718900 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4badc9f4-8a31-401d-8d82-b2ca7d5e58ea tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:52.719334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4badc9f4-8a31-401d-8d82-b2ca7d5e58ea tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:52.862191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4badc9f4-8a31-401d-8d82-b2ca7d5e58ea tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:52.871006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4badc9f4-8a31-401d-8d82-b2ca7d5e58ea tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.164467 Jul 18 17:08:52.871591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 473/1072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:52 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:53.888668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a352cc22-e7f9-49ae-b904-cf31033522da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:53.889276 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a352cc22-e7f9-49ae-b904-cf31033522da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:53.895577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a352cc22-e7f9-49ae-b904-cf31033522da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:53.895943 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a352cc22-e7f9-49ae-b904-cf31033522da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:53.896731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a352cc22-e7f9-49ae-b904-cf31033522da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:53.897169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a352cc22-e7f9-49ae-b904-cf31033522da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:54.035119 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a352cc22-e7f9-49ae-b904-cf31033522da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:54.043314 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a352cc22-e7f9-49ae-b904-cf31033522da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.159133 Jul 18 17:08:54.043914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 600/1073] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:53 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:55.061126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0468a22f-3f7f-4824-8def-d11af01ec79c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:55.061734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0468a22f-3f7f-4824-8def-d11af01ec79c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:55.068679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0468a22f-3f7f-4824-8def-d11af01ec79c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:55.069119 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0468a22f-3f7f-4824-8def-d11af01ec79c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:55.069903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0468a22f-3f7f-4824-8def-d11af01ec79c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:55.070338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0468a22f-3f7f-4824-8def-d11af01ec79c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:55.203040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0468a22f-3f7f-4824-8def-d11af01ec79c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:55.211005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0468a22f-3f7f-4824-8def-d11af01ec79c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153837 Jul 18 17:08:55.211581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 474/1074] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:55 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:56.229581 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-90df9c75-def7-40cf-a46a-c177c2e62015 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:56.230164 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-90df9c75-def7-40cf-a46a-c177c2e62015 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:56.236286 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-90df9c75-def7-40cf-a46a-c177c2e62015 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:56.236721 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-90df9c75-def7-40cf-a46a-c177c2e62015 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:56.237473 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-90df9c75-def7-40cf-a46a-c177c2e62015 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:56.237913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-90df9c75-def7-40cf-a46a-c177c2e62015 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:56.371879 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-90df9c75-def7-40cf-a46a-c177c2e62015 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:56.380005 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-90df9c75-def7-40cf-a46a-c177c2e62015 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155151 Jul 18 17:08:56.380583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 601/1075] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:56 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:57.397604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1796bb47-aff7-4e9e-ac80-4d684b497e88 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:57.398209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1796bb47-aff7-4e9e-ac80-4d684b497e88 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:57.404880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1796bb47-aff7-4e9e-ac80-4d684b497e88 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:57.405328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1796bb47-aff7-4e9e-ac80-4d684b497e88 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:57.406092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1796bb47-aff7-4e9e-ac80-4d684b497e88 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:57.406526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1796bb47-aff7-4e9e-ac80-4d684b497e88 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:57.543436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1796bb47-aff7-4e9e-ac80-4d684b497e88 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:57.551558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1796bb47-aff7-4e9e-ac80-4d684b497e88 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157741 Jul 18 17:08:57.552388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 475/1076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:57 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:58.570952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2f02c9ec-7fec-4121-8827-1be2225beb80 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:58.572214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2f02c9ec-7fec-4121-8827-1be2225beb80 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:58.578612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2f02c9ec-7fec-4121-8827-1be2225beb80 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:58.579060 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2f02c9ec-7fec-4121-8827-1be2225beb80 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:58.579857 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2f02c9ec-7fec-4121-8827-1be2225beb80 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:58.580423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2f02c9ec-7fec-4121-8827-1be2225beb80 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:58.713445 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2f02c9ec-7fec-4121-8827-1be2225beb80 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:58.721487 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2f02c9ec-7fec-4121-8827-1be2225beb80 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154745 Jul 18 17:08:58.722053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 602/1077] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:58 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:08:59.738037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-78172f6b-42be-4e53-a472-9732ce1fb2f9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:08:59.738632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-78172f6b-42be-4e53-a472-9732ce1fb2f9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:08:59.746261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78172f6b-42be-4e53-a472-9732ce1fb2f9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:59.747013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78172f6b-42be-4e53-a472-9732ce1fb2f9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:59.748188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78172f6b-42be-4e53-a472-9732ce1fb2f9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:08:59.748954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78172f6b-42be-4e53-a472-9732ce1fb2f9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:08:59.886446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-78172f6b-42be-4e53-a472-9732ce1fb2f9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:08:59.894505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-78172f6b-42be-4e53-a472-9732ce1fb2f9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.160304 Jul 18 17:08:59.895064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 476/1078] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:08:59 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:00.911871 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9e1c0b35-7752-491d-a579-e9ed04be3867 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:00.912404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9e1c0b35-7752-491d-a579-e9ed04be3867 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:00.919532 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e1c0b35-7752-491d-a579-e9ed04be3867 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:00.919989 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e1c0b35-7752-491d-a579-e9ed04be3867 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:00.920763 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e1c0b35-7752-491d-a579-e9ed04be3867 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:00.921196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9e1c0b35-7752-491d-a579-e9ed04be3867 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:01.051280 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9e1c0b35-7752-491d-a579-e9ed04be3867 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:01.059702 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9e1c0b35-7752-491d-a579-e9ed04be3867 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151690 Jul 18 17:09:01.060274 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 603/1079] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:00 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:02.076836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a42077ca-c65f-4940-b30e-51740ce5336b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:02.077443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a42077ca-c65f-4940-b30e-51740ce5336b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:02.079855 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=27 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:02.085097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a42077ca-c65f-4940-b30e-51740ce5336b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:02.085545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a42077ca-c65f-4940-b30e-51740ce5336b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:02.086358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a42077ca-c65f-4940-b30e-51740ce5336b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:02.086817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a42077ca-c65f-4940-b30e-51740ce5336b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:02.089688 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=79 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:02.223279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a42077ca-c65f-4940-b30e-51740ce5336b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:02.231394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a42077ca-c65f-4940-b30e-51740ce5336b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.158456 Jul 18 17:09:02.231988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 477/1080] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:02 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:03.248618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4c5f028d-4611-4747-b5e5-c320b632efbe tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:03.249212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4c5f028d-4611-4747-b5e5-c320b632efbe tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:03.251142 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:03.255847 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c5f028d-4611-4747-b5e5-c320b632efbe tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:03.256287 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c5f028d-4611-4747-b5e5-c320b632efbe tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:03.257027 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c5f028d-4611-4747-b5e5-c320b632efbe tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:03.257451 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c5f028d-4611-4747-b5e5-c320b632efbe tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:03.260034 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:03.394279 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4c5f028d-4611-4747-b5e5-c320b632efbe tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:03.403178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4c5f028d-4611-4747-b5e5-c320b632efbe tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.158390 Jul 18 17:09:03.403820 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 604/1081] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:03 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:04.420860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-69bbf744-4890-4c2b-aeb4-ae402b7583ae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:04.421410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-69bbf744-4890-4c2b-aeb4-ae402b7583ae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:04.427743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69bbf744-4890-4c2b-aeb4-ae402b7583ae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:04.428193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69bbf744-4890-4c2b-aeb4-ae402b7583ae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:04.428951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69bbf744-4890-4c2b-aeb4-ae402b7583ae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:04.429391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69bbf744-4890-4c2b-aeb4-ae402b7583ae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:04.560774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69bbf744-4890-4c2b-aeb4-ae402b7583ae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:04.568853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-69bbf744-4890-4c2b-aeb4-ae402b7583ae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152204 Jul 18 17:09:04.569429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 478/1082] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:04 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:05.586002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dc3c5268-623d-438c-8663-d67158ac2838 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:05.586592 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dc3c5268-623d-438c-8663-d67158ac2838 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:05.593560 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc3c5268-623d-438c-8663-d67158ac2838 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:05.594002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc3c5268-623d-438c-8663-d67158ac2838 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:05.594754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc3c5268-623d-438c-8663-d67158ac2838 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:05.595186 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dc3c5268-623d-438c-8663-d67158ac2838 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:05.738068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dc3c5268-623d-438c-8663-d67158ac2838 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:05.747036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dc3c5268-623d-438c-8663-d67158ac2838 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.165205 Jul 18 17:09:05.747628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 605/1083] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:05 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:06.765069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b3bcfc2d-43eb-4bae-9353-e1808be0b380 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:06.765703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b3bcfc2d-43eb-4bae-9353-e1808be0b380 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:06.772729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3bcfc2d-43eb-4bae-9353-e1808be0b380 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:06.773448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3bcfc2d-43eb-4bae-9353-e1808be0b380 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:06.774236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3bcfc2d-43eb-4bae-9353-e1808be0b380 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:06.774676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3bcfc2d-43eb-4bae-9353-e1808be0b380 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:06.915264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b3bcfc2d-43eb-4bae-9353-e1808be0b380 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:06.923698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b3bcfc2d-43eb-4bae-9353-e1808be0b380 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.162511 Jul 18 17:09:06.924861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 479/1084] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:06 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:07.941624 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1f40bf8e-887e-4b1c-9cd0-04a047f62e7f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:07.942262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1f40bf8e-887e-4b1c-9cd0-04a047f62e7f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:07.949746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1f40bf8e-887e-4b1c-9cd0-04a047f62e7f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:07.950190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1f40bf8e-887e-4b1c-9cd0-04a047f62e7f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:07.950990 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1f40bf8e-887e-4b1c-9cd0-04a047f62e7f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:07.951443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1f40bf8e-887e-4b1c-9cd0-04a047f62e7f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:08.097143 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1f40bf8e-887e-4b1c-9cd0-04a047f62e7f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:08.105561 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1f40bf8e-887e-4b1c-9cd0-04a047f62e7f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.167716 Jul 18 17:09:08.106748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 606/1085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:07 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:09.124235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9e861e3f-79ec-4f12-af7a-1b3f3abab214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:09.124762 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9e861e3f-79ec-4f12-af7a-1b3f3abab214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:09.131175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e861e3f-79ec-4f12-af7a-1b3f3abab214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:09.131639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e861e3f-79ec-4f12-af7a-1b3f3abab214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:09.132389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e861e3f-79ec-4f12-af7a-1b3f3abab214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:09.132815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e861e3f-79ec-4f12-af7a-1b3f3abab214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:09.272350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9e861e3f-79ec-4f12-af7a-1b3f3abab214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:09.281275 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9e861e3f-79ec-4f12-af7a-1b3f3abab214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.160899 Jul 18 17:09:09.281847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 480/1086] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:09 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:10.298219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-688943d9-3e95-44f5-a06d-0de55b8f99e7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:10.298854 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-688943d9-3e95-44f5-a06d-0de55b8f99e7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:10.305360 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-688943d9-3e95-44f5-a06d-0de55b8f99e7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:10.305803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-688943d9-3e95-44f5-a06d-0de55b8f99e7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:10.306644 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-688943d9-3e95-44f5-a06d-0de55b8f99e7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:10.307269 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-688943d9-3e95-44f5-a06d-0de55b8f99e7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:10.437049 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-688943d9-3e95-44f5-a06d-0de55b8f99e7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:10.444905 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-688943d9-3e95-44f5-a06d-0de55b8f99e7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150621 Jul 18 17:09:10.445471 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 607/1087] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:10 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:11.463567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-44b48ad9-9930-44d8-92b8-48d33d3ed30e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:11.464247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-44b48ad9-9930-44d8-92b8-48d33d3ed30e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:11.470746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-44b48ad9-9930-44d8-92b8-48d33d3ed30e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:11.471197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-44b48ad9-9930-44d8-92b8-48d33d3ed30e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:11.472263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-44b48ad9-9930-44d8-92b8-48d33d3ed30e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:11.472708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-44b48ad9-9930-44d8-92b8-48d33d3ed30e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:11.603390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-44b48ad9-9930-44d8-92b8-48d33d3ed30e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:11.611279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-44b48ad9-9930-44d8-92b8-48d33d3ed30e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152206 Jul 18 17:09:11.611866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 481/1088] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:11 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:12.627805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6376154e-55c2-49ce-88b2-0b62e0af31b2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:12.628441 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6376154e-55c2-49ce-88b2-0b62e0af31b2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:12.635342 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6376154e-55c2-49ce-88b2-0b62e0af31b2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:12.635847 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6376154e-55c2-49ce-88b2-0b62e0af31b2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:12.636669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6376154e-55c2-49ce-88b2-0b62e0af31b2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:12.637106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6376154e-55c2-49ce-88b2-0b62e0af31b2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:12.767461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6376154e-55c2-49ce-88b2-0b62e0af31b2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:12.775643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6376154e-55c2-49ce-88b2-0b62e0af31b2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151604 Jul 18 17:09:12.776211 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 608/1089] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:12 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:13.793379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-282d82d6-ef77-4bbb-9469-4b419ac42ea9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:13.793980 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-282d82d6-ef77-4bbb-9469-4b419ac42ea9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:13.800774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-282d82d6-ef77-4bbb-9469-4b419ac42ea9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:13.801219 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-282d82d6-ef77-4bbb-9469-4b419ac42ea9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:13.802229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-282d82d6-ef77-4bbb-9469-4b419ac42ea9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:13.802664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-282d82d6-ef77-4bbb-9469-4b419ac42ea9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:13.942563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-282d82d6-ef77-4bbb-9469-4b419ac42ea9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:13.951130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-282d82d6-ef77-4bbb-9469-4b419ac42ea9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.162333 Jul 18 17:09:13.951731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 482/1090] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:13 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:14.968243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1a911b37-e688-414a-af3a-eab3f1ebb345 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:14.968875 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1a911b37-e688-414a-af3a-eab3f1ebb345 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:14.974802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a911b37-e688-414a-af3a-eab3f1ebb345 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:14.975241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a911b37-e688-414a-af3a-eab3f1ebb345 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:14.976098 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a911b37-e688-414a-af3a-eab3f1ebb345 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:14.976446 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a911b37-e688-414a-af3a-eab3f1ebb345 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:15.111959 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1a911b37-e688-414a-af3a-eab3f1ebb345 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:15.120262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1a911b37-e688-414a-af3a-eab3f1ebb345 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155778 Jul 18 17:09:15.121329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 609/1091] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:14 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:16.139968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-18b7f753-8992-4467-acc1-58024d4b86e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:16.140591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-18b7f753-8992-4467-acc1-58024d4b86e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:16.147287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18b7f753-8992-4467-acc1-58024d4b86e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:16.151418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18b7f753-8992-4467-acc1-58024d4b86e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:16.151418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18b7f753-8992-4467-acc1-58024d4b86e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:16.151418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18b7f753-8992-4467-acc1-58024d4b86e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:16.297300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-18b7f753-8992-4467-acc1-58024d4b86e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:16.305604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-18b7f753-8992-4467-acc1-58024d4b86e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.170996 Jul 18 17:09:16.306164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 483/1092] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:16 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:17.324165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7105cefd-5201-4f71-a7cf-a6bd9abf17cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:17.324834 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7105cefd-5201-4f71-a7cf-a6bd9abf17cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:17.330899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7105cefd-5201-4f71-a7cf-a6bd9abf17cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:17.331340 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7105cefd-5201-4f71-a7cf-a6bd9abf17cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:17.332125 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7105cefd-5201-4f71-a7cf-a6bd9abf17cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:17.332558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7105cefd-5201-4f71-a7cf-a6bd9abf17cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:17.461173 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7105cefd-5201-4f71-a7cf-a6bd9abf17cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:17.470143 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7105cefd-5201-4f71-a7cf-a6bd9abf17cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.149720 Jul 18 17:09:17.470649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 610/1093] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:17 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:18.487347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-12d913c2-7882-4f3e-b2c1-47a4f06da636 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:18.487961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-12d913c2-7882-4f3e-b2c1-47a4f06da636 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:18.494495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12d913c2-7882-4f3e-b2c1-47a4f06da636 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:18.494947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12d913c2-7882-4f3e-b2c1-47a4f06da636 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:18.496416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12d913c2-7882-4f3e-b2c1-47a4f06da636 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:18.496851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12d913c2-7882-4f3e-b2c1-47a4f06da636 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:18.630862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-12d913c2-7882-4f3e-b2c1-47a4f06da636 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:18.638948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-12d913c2-7882-4f3e-b2c1-47a4f06da636 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155697 Jul 18 17:09:18.639518 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 484/1094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:18 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:19.656413 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ba8632c9-3357-4718-a9b6-02500c6fe47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:19.657021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ba8632c9-3357-4718-a9b6-02500c6fe47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:19.663020 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba8632c9-3357-4718-a9b6-02500c6fe47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:19.663462 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba8632c9-3357-4718-a9b6-02500c6fe47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:19.664291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba8632c9-3357-4718-a9b6-02500c6fe47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:19.664736 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba8632c9-3357-4718-a9b6-02500c6fe47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:19.797712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ba8632c9-3357-4718-a9b6-02500c6fe47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:19.805960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ba8632c9-3357-4718-a9b6-02500c6fe47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153479 Jul 18 17:09:19.806530 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 611/1095] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:19 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:20.824108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fedf9a60-d1c0-42b5-a4ee-cc9f68337702 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:20.825677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fedf9a60-d1c0-42b5-a4ee-cc9f68337702 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:20.832676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fedf9a60-d1c0-42b5-a4ee-cc9f68337702 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:20.838309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fedf9a60-d1c0-42b5-a4ee-cc9f68337702 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:20.838309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fedf9a60-d1c0-42b5-a4ee-cc9f68337702 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:20.838309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fedf9a60-d1c0-42b5-a4ee-cc9f68337702 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:20.970062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fedf9a60-d1c0-42b5-a4ee-cc9f68337702 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:20.981018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fedf9a60-d1c0-42b5-a4ee-cc9f68337702 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.160720 Jul 18 17:09:20.981603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 485/1096] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:20 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:21.998399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-822e75bf-05d1-4d35-98a6-ddffffbb56c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:21.999030 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-822e75bf-05d1-4d35-98a6-ddffffbb56c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:22.005214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-822e75bf-05d1-4d35-98a6-ddffffbb56c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:22.005661 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-822e75bf-05d1-4d35-98a6-ddffffbb56c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:22.006421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-822e75bf-05d1-4d35-98a6-ddffffbb56c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:22.006855 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-822e75bf-05d1-4d35-98a6-ddffffbb56c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:22.141055 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-822e75bf-05d1-4d35-98a6-ddffffbb56c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:22.149052 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-822e75bf-05d1-4d35-98a6-ddffffbb56c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154807 Jul 18 17:09:22.149605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 612/1097] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:21 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:23.166311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-87caac2f-87d0-4754-8892-a0ca7cf94b9f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:23.166954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-87caac2f-87d0-4754-8892-a0ca7cf94b9f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:23.174508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-87caac2f-87d0-4754-8892-a0ca7cf94b9f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:23.175006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-87caac2f-87d0-4754-8892-a0ca7cf94b9f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:23.175812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-87caac2f-87d0-4754-8892-a0ca7cf94b9f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:23.176504 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-87caac2f-87d0-4754-8892-a0ca7cf94b9f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:23.315485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-87caac2f-87d0-4754-8892-a0ca7cf94b9f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:23.323531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-87caac2f-87d0-4754-8892-a0ca7cf94b9f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.161252 Jul 18 17:09:23.324091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 486/1098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:23 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:23.844303 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c48e82c5-436d-40db-b1f2-9d74fea0310a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:23.844833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c48e82c5-436d-40db-b1f2-9d74fea0310a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:23.850874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c48e82c5-436d-40db-b1f2-9d74fea0310a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:23.851323 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c48e82c5-436d-40db-b1f2-9d74fea0310a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:23.852320 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c48e82c5-436d-40db-b1f2-9d74fea0310a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:23.852759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c48e82c5-436d-40db-b1f2-9d74fea0310a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:23.878569 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c48e82c5-436d-40db-b1f2-9d74fea0310a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Going to try to terminate instance {{(pid=124945) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:09:24.263045 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c48e82c5-436d-40db-b1f2-9d74fea0310a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 204 len: 0 microversion: 2.1 time: 0.422896 Jul 18 17:09:24.263646 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 613/1099] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:09:23 2022] DELETE /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:09:24.274012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8fe0d590-1a76-49af-afd3-d8d38b7f9e9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:24.274012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8fe0d590-1a76-49af-afd3-d8d38b7f9e9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:24.280356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8fe0d590-1a76-49af-afd3-d8d38b7f9e9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:24.280585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8fe0d590-1a76-49af-afd3-d8d38b7f9e9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:24.282201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8fe0d590-1a76-49af-afd3-d8d38b7f9e9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:24.282201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8fe0d590-1a76-49af-afd3-d8d38b7f9e9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:24.341672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-625df5af-d3b8-499b-aae9-1a61868da1f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:24.342422 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-625df5af-d3b8-499b-aae9-1a61868da1f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:24.349040 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-625df5af-d3b8-499b-aae9-1a61868da1f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:24.349483 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-625df5af-d3b8-499b-aae9-1a61868da1f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:24.350371 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-625df5af-d3b8-499b-aae9-1a61868da1f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:24.350718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-625df5af-d3b8-499b-aae9-1a61868da1f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:24.423141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8fe0d590-1a76-49af-afd3-d8d38b7f9e9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:24.432615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8fe0d590-1a76-49af-afd3-d8d38b7f9e9b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1721 microversion: 2.1 time: 0.164623 Jul 18 17:09:24.433187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 487/1100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:24.493534 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-625df5af-d3b8-499b-aae9-1a61868da1f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:24.502524 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-625df5af-d3b8-499b-aae9-1a61868da1f8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.165389 Jul 18 17:09:24.503104 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 614/1101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:24 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:25.451477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-82b8db40-1174-4d3b-bec6-c71d671f9e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:25.452059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-82b8db40-1174-4d3b-bec6-c71d671f9e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:25.458438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82b8db40-1174-4d3b-bec6-c71d671f9e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:25.458881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82b8db40-1174-4d3b-bec6-c71d671f9e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:25.459668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82b8db40-1174-4d3b-bec6-c71d671f9e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:25.460105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82b8db40-1174-4d3b-bec6-c71d671f9e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:25.520025 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a81006c3-8d10-49b7-9182-5828fed8af7e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:25.520679 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a81006c3-8d10-49b7-9182-5828fed8af7e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:25.527206 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a81006c3-8d10-49b7-9182-5828fed8af7e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:25.527774 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a81006c3-8d10-49b7-9182-5828fed8af7e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:25.528817 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a81006c3-8d10-49b7-9182-5828fed8af7e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:25.529258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a81006c3-8d10-49b7-9182-5828fed8af7e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:25.665241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a81006c3-8d10-49b7-9182-5828fed8af7e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:25.673489 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a81006c3-8d10-49b7-9182-5828fed8af7e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157643 Jul 18 17:09:25.674061 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 615/1102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:25 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:25.715001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-82b8db40-1174-4d3b-bec6-c71d671f9e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:25.723723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-82b8db40-1174-4d3b-bec6-c71d671f9e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1721 microversion: 2.1 time: 0.277059 Jul 18 17:09:25.724425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 488/1103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:25.971791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [req-4571bd6b-7190-4215-8353-09d26d4ad100 req-79c51300-7ef0-4d4d-abf7-8a74bcb8b84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dee0085-26fb-4535-8630-6f96f19445f5", "name": "network-vif-deleted", "tag": "49c5aa19-e689-4128-befe-ef9cd042860a"}]} {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:09:25.981837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-4571bd6b-7190-4215-8353-09d26d4ad100 req-79c51300-7ef0-4d4d-abf7-8a74bcb8b84e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:25.982439 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [req-4571bd6b-7190-4215-8353-09d26d4ad100 req-79c51300-7ef0-4d4d-abf7-8a74bcb8b84e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:25.999878 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.compute.server_external_events [req-4571bd6b-7190-4215-8353-09d26d4ad100 req-79c51300-7ef0-4d4d-abf7-8a74bcb8b84e service nova] Creating event network-vif-deleted:49c5aa19-e689-4128-befe-ef9cd042860a for instance 7dee0085-26fb-4535-8630-6f96f19445f5 on hv-cinder-84617 Jul 18 17:09:26.005972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [req-4571bd6b-7190-4215-8353-09d26d4ad100 req-79c51300-7ef0-4d4d-abf7-8a74bcb8b84e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111732 Jul 18 17:09:26.006573 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 616/1104] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:09:26.547722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:09:26.548430 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:09:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:09:26.690260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7675ccfc-6050-4cae-83b9-532e19b8589f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:26.690863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7675ccfc-6050-4cae-83b9-532e19b8589f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:26.697473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7675ccfc-6050-4cae-83b9-532e19b8589f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:26.697956 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7675ccfc-6050-4cae-83b9-532e19b8589f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:26.698680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7675ccfc-6050-4cae-83b9-532e19b8589f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:26.699126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7675ccfc-6050-4cae-83b9-532e19b8589f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:26.741870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-743312e2-3b28-4f12-b21d-2e713cda03e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:26.743443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-743312e2-3b28-4f12-b21d-2e713cda03e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:26.750890 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-743312e2-3b28-4f12-b21d-2e713cda03e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:26.751327 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-743312e2-3b28-4f12-b21d-2e713cda03e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:26.752154 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-743312e2-3b28-4f12-b21d-2e713cda03e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:26.752578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-743312e2-3b28-4f12-b21d-2e713cda03e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:26.817958 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-743312e2-3b28-4f12-b21d-2e713cda03e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:26.826968 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-743312e2-3b28-4f12-b21d-2e713cda03e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.089371 Jul 18 17:09:26.833364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 617/1105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:26.841959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7675ccfc-6050-4cae-83b9-532e19b8589f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:26.850546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7675ccfc-6050-4cae-83b9-532e19b8589f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.164110 Jul 18 17:09:26.858059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 489/1106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:26 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:27.849903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-609a6fa5-855c-4fc3-96e9-450c2037f043 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:27.850509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-609a6fa5-855c-4fc3-96e9-450c2037f043 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:27.857129 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-609a6fa5-855c-4fc3-96e9-450c2037f043 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:27.857569 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-609a6fa5-855c-4fc3-96e9-450c2037f043 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:27.858316 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-609a6fa5-855c-4fc3-96e9-450c2037f043 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:27.858746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-609a6fa5-855c-4fc3-96e9-450c2037f043 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:27.874103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7519c8b1-c363-4fb7-860e-c7f122d294f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:27.874713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7519c8b1-c363-4fb7-860e-c7f122d294f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:27.881310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7519c8b1-c363-4fb7-860e-c7f122d294f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:27.881761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7519c8b1-c363-4fb7-860e-c7f122d294f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:27.882537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7519c8b1-c363-4fb7-860e-c7f122d294f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:27.882976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7519c8b1-c363-4fb7-860e-c7f122d294f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:27.923354 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-609a6fa5-855c-4fc3-96e9-450c2037f043 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:27.931928 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-609a6fa5-855c-4fc3-96e9-450c2037f043 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085867 Jul 18 17:09:27.932502 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 618/1107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:28.014302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7519c8b1-c363-4fb7-860e-c7f122d294f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:28.022744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7519c8b1-c363-4fb7-860e-c7f122d294f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153420 Jul 18 17:09:28.023535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 490/1108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:27 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:28.950144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c28606ba-da8d-4e63-a5a2-a3ade9e92268 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:28.950694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c28606ba-da8d-4e63-a5a2-a3ade9e92268 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:28.956888 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c28606ba-da8d-4e63-a5a2-a3ade9e92268 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:28.957322 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c28606ba-da8d-4e63-a5a2-a3ade9e92268 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:28.958080 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c28606ba-da8d-4e63-a5a2-a3ade9e92268 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:28.958517 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c28606ba-da8d-4e63-a5a2-a3ade9e92268 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:29.024303 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c28606ba-da8d-4e63-a5a2-a3ade9e92268 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:29.026464 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:29.033577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c28606ba-da8d-4e63-a5a2-a3ade9e92268 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087718 Jul 18 17:09:29.034156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 619/1109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:28 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:29.040227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-157545ed-b139-49bb-bc82-b6189a2d14e5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:29.040831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-157545ed-b139-49bb-bc82-b6189a2d14e5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:29.048459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-157545ed-b139-49bb-bc82-b6189a2d14e5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:29.048895 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-157545ed-b139-49bb-bc82-b6189a2d14e5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:29.049664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-157545ed-b139-49bb-bc82-b6189a2d14e5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:29.050133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-157545ed-b139-49bb-bc82-b6189a2d14e5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:29.182366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-157545ed-b139-49bb-bc82-b6189a2d14e5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:29.190565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-157545ed-b139-49bb-bc82-b6189a2d14e5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154172 Jul 18 17:09:29.191124 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 491/1110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:29 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:29.949944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:09:29.950168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:09:30.052099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6a54b6c4-6314-414c-ac1d-158528bae85d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:30.052703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6a54b6c4-6314-414c-ac1d-158528bae85d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:30.059819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6a54b6c4-6314-414c-ac1d-158528bae85d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:30.060280 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6a54b6c4-6314-414c-ac1d-158528bae85d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:30.061065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6a54b6c4-6314-414c-ac1d-158528bae85d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:30.061503 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6a54b6c4-6314-414c-ac1d-158528bae85d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:30.125468 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6a54b6c4-6314-414c-ac1d-158528bae85d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:30.133552 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6a54b6c4-6314-414c-ac1d-158528bae85d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086002 Jul 18 17:09:30.134111 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 620/1111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:30.208139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1534bd77-b5ac-4c18-bb5c-02f25c39e24f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:30.208748 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1534bd77-b5ac-4c18-bb5c-02f25c39e24f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:30.215697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1534bd77-b5ac-4c18-bb5c-02f25c39e24f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:30.216150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1534bd77-b5ac-4c18-bb5c-02f25c39e24f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:30.216920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1534bd77-b5ac-4c18-bb5c-02f25c39e24f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:30.217398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1534bd77-b5ac-4c18-bb5c-02f25c39e24f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:30.282163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:09:30.282389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:09:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:09:30.350116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1534bd77-b5ac-4c18-bb5c-02f25c39e24f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:30.359091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1534bd77-b5ac-4c18-bb5c-02f25c39e24f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154763 Jul 18 17:09:30.359699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 492/1112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:30 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:31.150573 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e3e41f03-44f0-4166-9271-f22c17c2323a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:31.151133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e3e41f03-44f0-4166-9271-f22c17c2323a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:31.157593 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3e41f03-44f0-4166-9271-f22c17c2323a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:31.158075 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3e41f03-44f0-4166-9271-f22c17c2323a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:31.158874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3e41f03-44f0-4166-9271-f22c17c2323a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:31.159261 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3e41f03-44f0-4166-9271-f22c17c2323a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:31.221529 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e3e41f03-44f0-4166-9271-f22c17c2323a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:31.229673 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e3e41f03-44f0-4166-9271-f22c17c2323a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082906 Jul 18 17:09:31.230246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 621/1113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:31.512041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5dab9099-b7cc-46e6-8b6e-9e5b65b9cecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:31.512763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5dab9099-b7cc-46e6-8b6e-9e5b65b9cecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:31.518762 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dab9099-b7cc-46e6-8b6e-9e5b65b9cecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:31.519203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dab9099-b7cc-46e6-8b6e-9e5b65b9cecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:31.520010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dab9099-b7cc-46e6-8b6e-9e5b65b9cecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:31.520449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dab9099-b7cc-46e6-8b6e-9e5b65b9cecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:31.654763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5dab9099-b7cc-46e6-8b6e-9e5b65b9cecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:31.656987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:31.663678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5dab9099-b7cc-46e6-8b6e-9e5b65b9cecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.290632 Jul 18 17:09:31.664239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 493/1114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:31 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:32.246246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-efd7d8de-b959-46f1-9611-50e68e15a3c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:32.246859 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-efd7d8de-b959-46f1-9611-50e68e15a3c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:32.253072 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efd7d8de-b959-46f1-9611-50e68e15a3c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:32.253517 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efd7d8de-b959-46f1-9611-50e68e15a3c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:32.254278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efd7d8de-b959-46f1-9611-50e68e15a3c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:32.254718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efd7d8de-b959-46f1-9611-50e68e15a3c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:32.316201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-efd7d8de-b959-46f1-9611-50e68e15a3c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:32.324936 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-efd7d8de-b959-46f1-9611-50e68e15a3c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082274 Jul 18 17:09:32.325486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 622/1115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:32.691262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3b05cf49-cfd2-4902-bb65-937f85e1eb00 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:32.691842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3b05cf49-cfd2-4902-bb65-937f85e1eb00 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:32.694489 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=34 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:32.700013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b05cf49-cfd2-4902-bb65-937f85e1eb00 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:32.705325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b05cf49-cfd2-4902-bb65-937f85e1eb00 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:32.705325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b05cf49-cfd2-4902-bb65-937f85e1eb00 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:32.705325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b05cf49-cfd2-4902-bb65-937f85e1eb00 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:32.835859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3b05cf49-cfd2-4902-bb65-937f85e1eb00 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:32.845238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3b05cf49-cfd2-4902-bb65-937f85e1eb00 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157998 Jul 18 17:09:32.845798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 494/1116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:32 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:33.342178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1fd57e33-fc4c-448f-9c81-25ed8f96c110 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:33.342786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1fd57e33-fc4c-448f-9c81-25ed8f96c110 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:33.344662 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:33.349465 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fd57e33-fc4c-448f-9c81-25ed8f96c110 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:33.349913 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fd57e33-fc4c-448f-9c81-25ed8f96c110 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:33.350657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fd57e33-fc4c-448f-9c81-25ed8f96c110 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:33.351093 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fd57e33-fc4c-448f-9c81-25ed8f96c110 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:33.415109 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1fd57e33-fc4c-448f-9c81-25ed8f96c110 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:33.423041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1fd57e33-fc4c-448f-9c81-25ed8f96c110 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084842 Jul 18 17:09:33.423631 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 623/1117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:33 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:33.862454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-27758df2-91fa-40da-98f9-1284a0bf51ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:33.863059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-27758df2-91fa-40da-98f9-1284a0bf51ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:33.869577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27758df2-91fa-40da-98f9-1284a0bf51ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:33.870025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27758df2-91fa-40da-98f9-1284a0bf51ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:33.870969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27758df2-91fa-40da-98f9-1284a0bf51ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:33.871423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27758df2-91fa-40da-98f9-1284a0bf51ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:34.001062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-27758df2-91fa-40da-98f9-1284a0bf51ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:34.009299 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-27758df2-91fa-40da-98f9-1284a0bf51ff tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150886 Jul 18 17:09:34.009859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 495/1118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:33 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:34.440537 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e7376b97-9849-40de-8f69-a7855c10a49a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:34.441125 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e7376b97-9849-40de-8f69-a7855c10a49a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:34.447406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7376b97-9849-40de-8f69-a7855c10a49a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:34.447874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7376b97-9849-40de-8f69-a7855c10a49a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:34.448664 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7376b97-9849-40de-8f69-a7855c10a49a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:34.449107 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7376b97-9849-40de-8f69-a7855c10a49a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:34.512434 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e7376b97-9849-40de-8f69-a7855c10a49a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:34.522368 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e7376b97-9849-40de-8f69-a7855c10a49a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085296 Jul 18 17:09:34.522943 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 624/1119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:34 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:35.026460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2d2f9c08-af7f-4ac6-91c0-35d7004cb20b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:35.028141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2d2f9c08-af7f-4ac6-91c0-35d7004cb20b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:35.036208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c08-af7f-4ac6-91c0-35d7004cb20b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:35.036761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c08-af7f-4ac6-91c0-35d7004cb20b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:35.037566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c08-af7f-4ac6-91c0-35d7004cb20b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:35.037996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c08-af7f-4ac6-91c0-35d7004cb20b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:35.417110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2d2f9c08-af7f-4ac6-91c0-35d7004cb20b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:35.425324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2d2f9c08-af7f-4ac6-91c0-35d7004cb20b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.402732 Jul 18 17:09:35.426142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 496/1120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:35 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:35.539786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-61ed4d0e-501a-4cc7-845d-26375c77cbe1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:35.540417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-61ed4d0e-501a-4cc7-845d-26375c77cbe1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:35.546508 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-61ed4d0e-501a-4cc7-845d-26375c77cbe1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:35.546984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-61ed4d0e-501a-4cc7-845d-26375c77cbe1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:35.547729 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-61ed4d0e-501a-4cc7-845d-26375c77cbe1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:35.548162 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-61ed4d0e-501a-4cc7-845d-26375c77cbe1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:35.608874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-61ed4d0e-501a-4cc7-845d-26375c77cbe1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:35.616738 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-61ed4d0e-501a-4cc7-845d-26375c77cbe1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.080836 Jul 18 17:09:35.617294 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 625/1121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:36.443870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b4b63e22-186e-48bb-99b4-3a1aa367ae89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:36.444447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b4b63e22-186e-48bb-99b4-3a1aa367ae89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:36.451107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4b63e22-186e-48bb-99b4-3a1aa367ae89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:36.451560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4b63e22-186e-48bb-99b4-3a1aa367ae89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:36.452314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4b63e22-186e-48bb-99b4-3a1aa367ae89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:36.452743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4b63e22-186e-48bb-99b4-3a1aa367ae89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:36.585203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b4b63e22-186e-48bb-99b4-3a1aa367ae89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:36.594005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b4b63e22-186e-48bb-99b4-3a1aa367ae89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154452 Jul 18 17:09:36.594566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 497/1122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:36 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:36.633878 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0416ac14-802a-446c-9181-bbaa59ed6b11 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:36.634482 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0416ac14-802a-446c-9181-bbaa59ed6b11 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:36.641217 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0416ac14-802a-446c-9181-bbaa59ed6b11 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:36.641661 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0416ac14-802a-446c-9181-bbaa59ed6b11 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:36.642404 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0416ac14-802a-446c-9181-bbaa59ed6b11 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:36.642828 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0416ac14-802a-446c-9181-bbaa59ed6b11 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:36.706542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0416ac14-802a-446c-9181-bbaa59ed6b11 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:36.715293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0416ac14-802a-446c-9181-bbaa59ed6b11 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085213 Jul 18 17:09:36.715869 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 626/1123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:36 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:37.615293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-33682081-5339-4fd4-8c5b-04bb8a67e5b3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:37.618582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-33682081-5339-4fd4-8c5b-04bb8a67e5b3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:37.626147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33682081-5339-4fd4-8c5b-04bb8a67e5b3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:37.626596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33682081-5339-4fd4-8c5b-04bb8a67e5b3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:37.627374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33682081-5339-4fd4-8c5b-04bb8a67e5b3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:37.627838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33682081-5339-4fd4-8c5b-04bb8a67e5b3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:37.732569 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c24a42ab-adf5-43d5-99b5-01cc68716df7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:37.733199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c24a42ab-adf5-43d5-99b5-01cc68716df7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:37.739346 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c24a42ab-adf5-43d5-99b5-01cc68716df7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:37.739832 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c24a42ab-adf5-43d5-99b5-01cc68716df7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:37.740637 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c24a42ab-adf5-43d5-99b5-01cc68716df7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:37.741008 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c24a42ab-adf5-43d5-99b5-01cc68716df7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:37.764803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-33682081-5339-4fd4-8c5b-04bb8a67e5b3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:37.772951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-33682081-5339-4fd4-8c5b-04bb8a67e5b3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.164904 Jul 18 17:09:37.773524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 498/1124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:37 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:37.817306 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c24a42ab-adf5-43d5-99b5-01cc68716df7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:37.826163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c24a42ab-adf5-43d5-99b5-01cc68716df7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.098071 Jul 18 17:09:37.826716 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 627/1125] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:37 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:38.797049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a820acdf-1526-4f90-9f60-eda3c7326ac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:38.797667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a820acdf-1526-4f90-9f60-eda3c7326ac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:38.804765 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a820acdf-1526-4f90-9f60-eda3c7326ac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:38.805209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a820acdf-1526-4f90-9f60-eda3c7326ac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:38.806004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a820acdf-1526-4f90-9f60-eda3c7326ac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:38.806441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a820acdf-1526-4f90-9f60-eda3c7326ac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:38.843416 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-770d88af-5b3b-477d-ba11-2f00ce572be3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:38.844200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-770d88af-5b3b-477d-ba11-2f00ce572be3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:38.850801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-770d88af-5b3b-477d-ba11-2f00ce572be3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:38.851247 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-770d88af-5b3b-477d-ba11-2f00ce572be3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:38.852127 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-770d88af-5b3b-477d-ba11-2f00ce572be3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:38.852561 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-770d88af-5b3b-477d-ba11-2f00ce572be3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:38.918706 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-770d88af-5b3b-477d-ba11-2f00ce572be3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:38.928313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-770d88af-5b3b-477d-ba11-2f00ce572be3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.089228 Jul 18 17:09:38.931694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 628/1126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:38 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:38.950681 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a820acdf-1526-4f90-9f60-eda3c7326ac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:38.958820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a820acdf-1526-4f90-9f60-eda3c7326ac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.166392 Jul 18 17:09:38.959378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 499/1127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:38 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:39.945505 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-da23ded2-3b57-43eb-909e-5f16af7e49e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:39.946097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-da23ded2-3b57-43eb-909e-5f16af7e49e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:39.952194 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-da23ded2-3b57-43eb-909e-5f16af7e49e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:39.952636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-da23ded2-3b57-43eb-909e-5f16af7e49e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:39.953388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-da23ded2-3b57-43eb-909e-5f16af7e49e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:39.953820 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-da23ded2-3b57-43eb-909e-5f16af7e49e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:39.976524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a29a213e-8395-4068-938d-4e389b8e3e22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:39.977132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a29a213e-8395-4068-938d-4e389b8e3e22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:39.984485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a29a213e-8395-4068-938d-4e389b8e3e22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:39.984939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a29a213e-8395-4068-938d-4e389b8e3e22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:39.985705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a29a213e-8395-4068-938d-4e389b8e3e22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:39.986138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a29a213e-8395-4068-938d-4e389b8e3e22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:40.015884 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-da23ded2-3b57-43eb-909e-5f16af7e49e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:40.023889 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-da23ded2-3b57-43eb-909e-5f16af7e49e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082129 Jul 18 17:09:40.024443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 629/1128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:39 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:40.121304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a29a213e-8395-4068-938d-4e389b8e3e22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:40.129409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a29a213e-8395-4068-938d-4e389b8e3e22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156731 Jul 18 17:09:40.133011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 500/1129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:39 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:41.042620 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8e987172-981e-44b0-a4a4-0ba07c71a709 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:41.043197 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8e987172-981e-44b0-a4a4-0ba07c71a709 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:41.049223 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e987172-981e-44b0-a4a4-0ba07c71a709 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:41.049668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e987172-981e-44b0-a4a4-0ba07c71a709 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:41.050412 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e987172-981e-44b0-a4a4-0ba07c71a709 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:41.051097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e987172-981e-44b0-a4a4-0ba07c71a709 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:41.113199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8e987172-981e-44b0-a4a4-0ba07c71a709 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:41.121771 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8e987172-981e-44b0-a4a4-0ba07c71a709 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083583 Jul 18 17:09:41.122321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 630/1130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:41 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:41.146372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-69ac2126-1079-4993-93dd-1382189f6137 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:41.146969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-69ac2126-1079-4993-93dd-1382189f6137 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:41.153737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69ac2126-1079-4993-93dd-1382189f6137 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:41.154164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69ac2126-1079-4993-93dd-1382189f6137 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:41.154914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69ac2126-1079-4993-93dd-1382189f6137 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:41.155346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69ac2126-1079-4993-93dd-1382189f6137 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:41.289182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69ac2126-1079-4993-93dd-1382189f6137 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:41.298112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-69ac2126-1079-4993-93dd-1382189f6137 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155554 Jul 18 17:09:41.298697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 501/1131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:41 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:42.138646 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d557495f-c1d1-40bd-a2f2-b49e26a960bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:42.139226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d557495f-c1d1-40bd-a2f2-b49e26a960bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:42.145236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d557495f-c1d1-40bd-a2f2-b49e26a960bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:42.145690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d557495f-c1d1-40bd-a2f2-b49e26a960bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:42.146446 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d557495f-c1d1-40bd-a2f2-b49e26a960bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:42.146884 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d557495f-c1d1-40bd-a2f2-b49e26a960bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:42.210511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d557495f-c1d1-40bd-a2f2-b49e26a960bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:42.219400 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d557495f-c1d1-40bd-a2f2-b49e26a960bf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085089 Jul 18 17:09:42.219997 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 631/1132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:42 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:42.316321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fd26347f-58b9-43c7-bf50-fbe31e57df56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:42.317040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fd26347f-58b9-43c7-bf50-fbe31e57df56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:42.324249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd26347f-58b9-43c7-bf50-fbe31e57df56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:42.324698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd26347f-58b9-43c7-bf50-fbe31e57df56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:42.325463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd26347f-58b9-43c7-bf50-fbe31e57df56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:42.325905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd26347f-58b9-43c7-bf50-fbe31e57df56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:42.457212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fd26347f-58b9-43c7-bf50-fbe31e57df56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:42.465498 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fd26347f-58b9-43c7-bf50-fbe31e57df56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153143 Jul 18 17:09:42.466070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 502/1133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:42 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:43.236686 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-fb5a6b25-be2c-475b-a556-78470ea4ad5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:43.237233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-fb5a6b25-be2c-475b-a556-78470ea4ad5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:43.243364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb5a6b25-be2c-475b-a556-78470ea4ad5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:43.243841 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb5a6b25-be2c-475b-a556-78470ea4ad5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:43.244603 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb5a6b25-be2c-475b-a556-78470ea4ad5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:43.245707 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fb5a6b25-be2c-475b-a556-78470ea4ad5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:43.306606 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-fb5a6b25-be2c-475b-a556-78470ea4ad5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:43.315393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-fb5a6b25-be2c-475b-a556-78470ea4ad5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082638 Jul 18 17:09:43.316026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 632/1134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:43 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:43.481996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2936a42d-84b8-4fee-94ac-4111cb43e2f4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:43.482589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2936a42d-84b8-4fee-94ac-4111cb43e2f4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:43.489206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2936a42d-84b8-4fee-94ac-4111cb43e2f4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:43.489599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2936a42d-84b8-4fee-94ac-4111cb43e2f4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:43.490357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2936a42d-84b8-4fee-94ac-4111cb43e2f4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:43.490794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2936a42d-84b8-4fee-94ac-4111cb43e2f4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:43.621428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2936a42d-84b8-4fee-94ac-4111cb43e2f4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:43.630601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2936a42d-84b8-4fee-94ac-4111cb43e2f4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152533 Jul 18 17:09:43.631168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 503/1135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:43 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:44.333419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e3139c5d-c147-4da8-aa3c-029fa6cc225c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:44.334018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e3139c5d-c147-4da8-aa3c-029fa6cc225c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:44.340393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3139c5d-c147-4da8-aa3c-029fa6cc225c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:44.340837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3139c5d-c147-4da8-aa3c-029fa6cc225c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:44.341585 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3139c5d-c147-4da8-aa3c-029fa6cc225c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:44.342022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e3139c5d-c147-4da8-aa3c-029fa6cc225c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:44.403252 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e3139c5d-c147-4da8-aa3c-029fa6cc225c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:44.411192 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e3139c5d-c147-4da8-aa3c-029fa6cc225c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081597 Jul 18 17:09:44.411835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 633/1136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:44 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:44.648697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c45471d7-3af2-4dbd-acc2-f987318f0ce5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:44.649239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c45471d7-3af2-4dbd-acc2-f987318f0ce5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:44.656592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c45471d7-3af2-4dbd-acc2-f987318f0ce5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:44.657036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c45471d7-3af2-4dbd-acc2-f987318f0ce5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:44.657796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c45471d7-3af2-4dbd-acc2-f987318f0ce5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:44.658232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c45471d7-3af2-4dbd-acc2-f987318f0ce5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:44.786140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c45471d7-3af2-4dbd-acc2-f987318f0ce5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:44.795141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c45471d7-3af2-4dbd-acc2-f987318f0ce5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150399 Jul 18 17:09:44.795734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 504/1137] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:44 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:45.429515 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-19ee8d81-3eac-43cc-b6f3-208eb17f859a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:45.430041 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-19ee8d81-3eac-43cc-b6f3-208eb17f859a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:45.436151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-19ee8d81-3eac-43cc-b6f3-208eb17f859a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:45.436591 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-19ee8d81-3eac-43cc-b6f3-208eb17f859a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:45.437349 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-19ee8d81-3eac-43cc-b6f3-208eb17f859a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:45.437770 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-19ee8d81-3eac-43cc-b6f3-208eb17f859a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:45.498858 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-19ee8d81-3eac-43cc-b6f3-208eb17f859a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:45.507007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-19ee8d81-3eac-43cc-b6f3-208eb17f859a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081794 Jul 18 17:09:45.507577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 634/1138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:45 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:45.812941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a5144355-9b29-423f-8ee5-bd6e1b470b55 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:45.813692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a5144355-9b29-423f-8ee5-bd6e1b470b55 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:45.820305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5144355-9b29-423f-8ee5-bd6e1b470b55 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:45.820758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5144355-9b29-423f-8ee5-bd6e1b470b55 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:45.821525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5144355-9b29-423f-8ee5-bd6e1b470b55 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:45.821967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5144355-9b29-423f-8ee5-bd6e1b470b55 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:45.964301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a5144355-9b29-423f-8ee5-bd6e1b470b55 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:45.972379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a5144355-9b29-423f-8ee5-bd6e1b470b55 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.163389 Jul 18 17:09:45.972948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 505/1139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:45 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:46.524699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-53d42597-5ed3-4da4-aca1-7b1fbd3cac00 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:46.525283 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-53d42597-5ed3-4da4-aca1-7b1fbd3cac00 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:46.531699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-53d42597-5ed3-4da4-aca1-7b1fbd3cac00 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:46.532195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-53d42597-5ed3-4da4-aca1-7b1fbd3cac00 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:46.532959 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-53d42597-5ed3-4da4-aca1-7b1fbd3cac00 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:46.533481 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-53d42597-5ed3-4da4-aca1-7b1fbd3cac00 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:46.601603 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-53d42597-5ed3-4da4-aca1-7b1fbd3cac00 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:46.610047 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-53d42597-5ed3-4da4-aca1-7b1fbd3cac00 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.089260 Jul 18 17:09:46.610600 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 635/1140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:46 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:46.989463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-118d5384-c494-4dc9-8f3c-7384d2d65fca tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:46.990103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-118d5384-c494-4dc9-8f3c-7384d2d65fca tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:46.996914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-118d5384-c494-4dc9-8f3c-7384d2d65fca tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:46.997366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-118d5384-c494-4dc9-8f3c-7384d2d65fca tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:46.998125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-118d5384-c494-4dc9-8f3c-7384d2d65fca tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:46.998562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-118d5384-c494-4dc9-8f3c-7384d2d65fca tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:47.129731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-118d5384-c494-4dc9-8f3c-7384d2d65fca tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:47.138377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-118d5384-c494-4dc9-8f3c-7384d2d65fca tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152812 Jul 18 17:09:47.138943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 506/1141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:46 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:47.627215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dd7530b7-1cdf-47e0-845c-c6dd64f12b21 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:47.627867 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dd7530b7-1cdf-47e0-845c-c6dd64f12b21 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:47.633854 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd7530b7-1cdf-47e0-845c-c6dd64f12b21 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:47.634292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd7530b7-1cdf-47e0-845c-c6dd64f12b21 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:47.635037 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd7530b7-1cdf-47e0-845c-c6dd64f12b21 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:47.636315 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd7530b7-1cdf-47e0-845c-c6dd64f12b21 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:47.650793 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:47.696823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dd7530b7-1cdf-47e0-845c-c6dd64f12b21 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:47.705350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dd7530b7-1cdf-47e0-845c-c6dd64f12b21 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081989 Jul 18 17:09:47.705904 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 636/1142] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:47 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:48.155798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-63013dbd-423f-4c28-b1e2-f828a6756966 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:48.156552 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-63013dbd-423f-4c28-b1e2-f828a6756966 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:48.162956 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63013dbd-423f-4c28-b1e2-f828a6756966 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:48.163403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63013dbd-423f-4c28-b1e2-f828a6756966 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:48.164216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63013dbd-423f-4c28-b1e2-f828a6756966 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:48.164651 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63013dbd-423f-4c28-b1e2-f828a6756966 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:48.310065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-63013dbd-423f-4c28-b1e2-f828a6756966 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:48.312194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-63013dbd-423f-4c28-b1e2-f828a6756966 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.160319 Jul 18 17:09:48.312753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 507/1143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:48 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:48.722670 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3737daf8-495b-4734-beaf-4e4b85b0f2d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:48.723266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3737daf8-495b-4734-beaf-4e4b85b0f2d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:48.730255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3737daf8-495b-4734-beaf-4e4b85b0f2d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:48.730709 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3737daf8-495b-4734-beaf-4e4b85b0f2d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:48.731525 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3737daf8-495b-4734-beaf-4e4b85b0f2d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:48.731934 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3737daf8-495b-4734-beaf-4e4b85b0f2d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:48.793411 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3737daf8-495b-4734-beaf-4e4b85b0f2d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:48.801697 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3737daf8-495b-4734-beaf-4e4b85b0f2d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083143 Jul 18 17:09:48.806346 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 637/1144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:48 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:49.329392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-20921e3f-a23d-4ee6-adb8-9615a2027899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:49.329988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-20921e3f-a23d-4ee6-adb8-9615a2027899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:49.336460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20921e3f-a23d-4ee6-adb8-9615a2027899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:49.336904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20921e3f-a23d-4ee6-adb8-9615a2027899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:49.337661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20921e3f-a23d-4ee6-adb8-9615a2027899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:49.338090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20921e3f-a23d-4ee6-adb8-9615a2027899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:49.471479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-20921e3f-a23d-4ee6-adb8-9615a2027899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:49.479520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-20921e3f-a23d-4ee6-adb8-9615a2027899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153904 Jul 18 17:09:49.480091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 508/1145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:49 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:49.820125 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8bf72a70-da07-42ad-b973-99e75eb09919 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:49.820722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8bf72a70-da07-42ad-b973-99e75eb09919 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:49.827718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8bf72a70-da07-42ad-b973-99e75eb09919 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:49.828171 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8bf72a70-da07-42ad-b973-99e75eb09919 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:49.828936 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8bf72a70-da07-42ad-b973-99e75eb09919 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:49.829372 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8bf72a70-da07-42ad-b973-99e75eb09919 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:49.893674 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8bf72a70-da07-42ad-b973-99e75eb09919 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:49.901820 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8bf72a70-da07-42ad-b973-99e75eb09919 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085509 Jul 18 17:09:49.902427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 638/1146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:49 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:50.496580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a44fe2a4-4e95-4934-af98-96d0a0fbe84d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:50.497179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a44fe2a4-4e95-4934-af98-96d0a0fbe84d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:50.503815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a44fe2a4-4e95-4934-af98-96d0a0fbe84d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:50.504261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a44fe2a4-4e95-4934-af98-96d0a0fbe84d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:50.505019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a44fe2a4-4e95-4934-af98-96d0a0fbe84d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:50.505456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a44fe2a4-4e95-4934-af98-96d0a0fbe84d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:50.633818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a44fe2a4-4e95-4934-af98-96d0a0fbe84d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:50.641862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a44fe2a4-4e95-4934-af98-96d0a0fbe84d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.149230 Jul 18 17:09:50.642427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 509/1147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:50 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:50.918868 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f0cc4685-5ab5-4fda-a994-ee99dacf3bc5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:50.919454 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f0cc4685-5ab5-4fda-a994-ee99dacf3bc5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:50.925993 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f0cc4685-5ab5-4fda-a994-ee99dacf3bc5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:50.928122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f0cc4685-5ab5-4fda-a994-ee99dacf3bc5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:50.928122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f0cc4685-5ab5-4fda-a994-ee99dacf3bc5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:50.928122 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f0cc4685-5ab5-4fda-a994-ee99dacf3bc5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:50.990804 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f0cc4685-5ab5-4fda-a994-ee99dacf3bc5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:50.999712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f0cc4685-5ab5-4fda-a994-ee99dacf3bc5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085170 Jul 18 17:09:51.000269 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 639/1148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:50 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:51.658774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-11cd0925-7391-4acf-adcd-d17a7bcb1d45 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:51.659382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-11cd0925-7391-4acf-adcd-d17a7bcb1d45 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:51.665941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11cd0925-7391-4acf-adcd-d17a7bcb1d45 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:51.666390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11cd0925-7391-4acf-adcd-d17a7bcb1d45 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:51.667158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11cd0925-7391-4acf-adcd-d17a7bcb1d45 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:51.667625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11cd0925-7391-4acf-adcd-d17a7bcb1d45 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:51.682573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:51.799648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-11cd0925-7391-4acf-adcd-d17a7bcb1d45 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:51.807937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-11cd0925-7391-4acf-adcd-d17a7bcb1d45 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153041 Jul 18 17:09:51.808567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 510/1149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:51 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:52.017592 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a6920e82-c76a-4561-9574-1b2fbf57cee8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:52.018273 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a6920e82-c76a-4561-9574-1b2fbf57cee8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:52.024408 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a6920e82-c76a-4561-9574-1b2fbf57cee8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:52.024848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a6920e82-c76a-4561-9574-1b2fbf57cee8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:52.025596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a6920e82-c76a-4561-9574-1b2fbf57cee8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:52.026025 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a6920e82-c76a-4561-9574-1b2fbf57cee8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:52.088728 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a6920e82-c76a-4561-9574-1b2fbf57cee8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:52.096956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a6920e82-c76a-4561-9574-1b2fbf57cee8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083295 Jul 18 17:09:52.097511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 640/1150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:52 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:52.825295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3634fe86-d892-40d9-85b6-d635775536e3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:52.825977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3634fe86-d892-40d9-85b6-d635775536e3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:52.832581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3634fe86-d892-40d9-85b6-d635775536e3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:52.833031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3634fe86-d892-40d9-85b6-d635775536e3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:52.833794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3634fe86-d892-40d9-85b6-d635775536e3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:52.834231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3634fe86-d892-40d9-85b6-d635775536e3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:52.972168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3634fe86-d892-40d9-85b6-d635775536e3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:52.980122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3634fe86-d892-40d9-85b6-d635775536e3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.158742 Jul 18 17:09:52.981312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 511/1151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:52 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:53.113830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4a901029-c8ff-4754-a357-f9976d1ed6e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:53.114428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4a901029-c8ff-4754-a357-f9976d1ed6e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:53.120501 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a901029-c8ff-4754-a357-f9976d1ed6e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:53.120953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a901029-c8ff-4754-a357-f9976d1ed6e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:53.121759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a901029-c8ff-4754-a357-f9976d1ed6e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:53.122178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4a901029-c8ff-4754-a357-f9976d1ed6e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:53.183317 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4a901029-c8ff-4754-a357-f9976d1ed6e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:53.191333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4a901029-c8ff-4754-a357-f9976d1ed6e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081284 Jul 18 17:09:53.191939 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 641/1152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:53 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:53.997768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-526142c3-a3e1-42fa-940b-6fa5993da888 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:53.998381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-526142c3-a3e1-42fa-940b-6fa5993da888 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:54.004903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-526142c3-a3e1-42fa-940b-6fa5993da888 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:54.005352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-526142c3-a3e1-42fa-940b-6fa5993da888 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:54.006112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-526142c3-a3e1-42fa-940b-6fa5993da888 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:54.006554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-526142c3-a3e1-42fa-940b-6fa5993da888 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:54.137307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-526142c3-a3e1-42fa-940b-6fa5993da888 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:54.145273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-526142c3-a3e1-42fa-940b-6fa5993da888 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151395 Jul 18 17:09:54.145836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 512/1153] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:53 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:54.208951 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ec1041e5-24bb-4538-b2f4-3b310bb9311c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:54.209526 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ec1041e5-24bb-4538-b2f4-3b310bb9311c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:54.215724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec1041e5-24bb-4538-b2f4-3b310bb9311c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:54.216168 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec1041e5-24bb-4538-b2f4-3b310bb9311c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:54.216919 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec1041e5-24bb-4538-b2f4-3b310bb9311c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:54.217347 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ec1041e5-24bb-4538-b2f4-3b310bb9311c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:54.278520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ec1041e5-24bb-4538-b2f4-3b310bb9311c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:54.286576 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ec1041e5-24bb-4538-b2f4-3b310bb9311c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081455 Jul 18 17:09:54.287132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 642/1154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:54 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:55.163812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-37767b50-51be-4dd7-bf35-693084cf1662 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:55.164420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37767b50-51be-4dd7-bf35-693084cf1662 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:55.171425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37767b50-51be-4dd7-bf35-693084cf1662 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:55.172017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37767b50-51be-4dd7-bf35-693084cf1662 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:55.172883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37767b50-51be-4dd7-bf35-693084cf1662 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:55.173328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37767b50-51be-4dd7-bf35-693084cf1662 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:55.303881 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-deb9c00b-07b5-41bf-b110-1c3e0ac655b5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:55.304597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-deb9c00b-07b5-41bf-b110-1c3e0ac655b5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:55.311088 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-deb9c00b-07b5-41bf-b110-1c3e0ac655b5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:55.311568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-deb9c00b-07b5-41bf-b110-1c3e0ac655b5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:55.312030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37767b50-51be-4dd7-bf35-693084cf1662 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:55.312337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-deb9c00b-07b5-41bf-b110-1c3e0ac655b5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:55.312770 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-deb9c00b-07b5-41bf-b110-1c3e0ac655b5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:55.320240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-37767b50-51be-4dd7-bf35-693084cf1662 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.160443 Jul 18 17:09:55.320914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 513/1155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:55 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:55.377113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-deb9c00b-07b5-41bf-b110-1c3e0ac655b5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:55.385023 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-deb9c00b-07b5-41bf-b110-1c3e0ac655b5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085252 Jul 18 17:09:55.385584 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 643/1156] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:55 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:56.338003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-260236ac-347a-4498-92da-1ad97a8a2ab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:56.338598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-260236ac-347a-4498-92da-1ad97a8a2ab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:56.345191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-260236ac-347a-4498-92da-1ad97a8a2ab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:56.345641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-260236ac-347a-4498-92da-1ad97a8a2ab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:56.346401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-260236ac-347a-4498-92da-1ad97a8a2ab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:56.346835 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-260236ac-347a-4498-92da-1ad97a8a2ab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:56.402273 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ac0cba20-832e-43cc-876f-c5135c040cf7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:56.402874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ac0cba20-832e-43cc-876f-c5135c040cf7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:56.409813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac0cba20-832e-43cc-876f-c5135c040cf7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:56.410266 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac0cba20-832e-43cc-876f-c5135c040cf7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:56.411028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac0cba20-832e-43cc-876f-c5135c040cf7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:56.411468 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ac0cba20-832e-43cc-876f-c5135c040cf7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:56.474345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ac0cba20-832e-43cc-876f-c5135c040cf7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:56.479200 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-260236ac-347a-4498-92da-1ad97a8a2ab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:56.483081 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ac0cba20-832e-43cc-876f-c5135c040cf7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084574 Jul 18 17:09:56.483669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 644/1157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:56 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:56.488376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-260236ac-347a-4498-92da-1ad97a8a2ab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153897 Jul 18 17:09:56.489308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 514/1158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:56 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:57.503324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6c3ce061-fc5b-457d-8b68-d376590c2d45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:57.503942 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6c3ce061-fc5b-457d-8b68-d376590c2d45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:57.505361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9ef85f14-6d17-4ad9-9a15-6d39dc7d4f8b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:57.505971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9ef85f14-6d17-4ad9-9a15-6d39dc7d4f8b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:57.510084 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6c3ce061-fc5b-457d-8b68-d376590c2d45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:57.510534 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6c3ce061-fc5b-457d-8b68-d376590c2d45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:57.511298 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6c3ce061-fc5b-457d-8b68-d376590c2d45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:57.511760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6c3ce061-fc5b-457d-8b68-d376590c2d45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:57.512424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ef85f14-6d17-4ad9-9a15-6d39dc7d4f8b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:57.513853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ef85f14-6d17-4ad9-9a15-6d39dc7d4f8b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:57.514679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ef85f14-6d17-4ad9-9a15-6d39dc7d4f8b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:57.515122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ef85f14-6d17-4ad9-9a15-6d39dc7d4f8b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:57.573916 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6c3ce061-fc5b-457d-8b68-d376590c2d45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:57.582258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6c3ce061-fc5b-457d-8b68-d376590c2d45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082737 Jul 18 17:09:57.582819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 645/1159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:57 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:57.652912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9ef85f14-6d17-4ad9-9a15-6d39dc7d4f8b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:57.661033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9ef85f14-6d17-4ad9-9a15-6d39dc7d4f8b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.159422 Jul 18 17:09:57.661592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 515/1160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:57 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:58.599822 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-798e4568-69b4-4eca-a300-7988af22b84b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:58.600412 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-798e4568-69b4-4eca-a300-7988af22b84b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:58.606499 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-798e4568-69b4-4eca-a300-7988af22b84b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:58.606960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-798e4568-69b4-4eca-a300-7988af22b84b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:58.607760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-798e4568-69b4-4eca-a300-7988af22b84b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:58.608212 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-798e4568-69b4-4eca-a300-7988af22b84b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:58.668339 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-798e4568-69b4-4eca-a300-7988af22b84b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:58.676616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-798e4568-69b4-4eca-a300-7988af22b84b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.080826 Jul 18 17:09:58.677337 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 646/1161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:58 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:58.678324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f090b556-f572-4168-bf79-ca093050bd87 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:58.678931 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f090b556-f572-4168-bf79-ca093050bd87 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:58.686373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f090b556-f572-4168-bf79-ca093050bd87 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:58.686817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f090b556-f572-4168-bf79-ca093050bd87 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:58.687625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f090b556-f572-4168-bf79-ca093050bd87 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:58.688059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f090b556-f572-4168-bf79-ca093050bd87 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:58.817715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f090b556-f572-4168-bf79-ca093050bd87 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:58.826364 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f090b556-f572-4168-bf79-ca093050bd87 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151986 Jul 18 17:09:58.827457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 516/1162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:58 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:09:59.693914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c290578a-46d6-45f9-bb44-ea7aee6e482f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:59.694715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c290578a-46d6-45f9-bb44-ea7aee6e482f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:59.700480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c290578a-46d6-45f9-bb44-ea7aee6e482f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:59.700926 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c290578a-46d6-45f9-bb44-ea7aee6e482f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:59.701675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c290578a-46d6-45f9-bb44-ea7aee6e482f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:59.702108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c290578a-46d6-45f9-bb44-ea7aee6e482f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:59.765233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c290578a-46d6-45f9-bb44-ea7aee6e482f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:59.773196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c290578a-46d6-45f9-bb44-ea7aee6e482f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083143 Jul 18 17:09:59.773753 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 647/1163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:59 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:09:59.844562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e32a69f9-ed97-4a2f-bbc4-b93d2b5d8d89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:09:59.845158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e32a69f9-ed97-4a2f-bbc4-b93d2b5d8d89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:09:59.851821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e32a69f9-ed97-4a2f-bbc4-b93d2b5d8d89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:59.852323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e32a69f9-ed97-4a2f-bbc4-b93d2b5d8d89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:59.853069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e32a69f9-ed97-4a2f-bbc4-b93d2b5d8d89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:09:59.853498 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e32a69f9-ed97-4a2f-bbc4-b93d2b5d8d89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:09:59.991324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e32a69f9-ed97-4a2f-bbc4-b93d2b5d8d89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:09:59.999819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e32a69f9-ed97-4a2f-bbc4-b93d2b5d8d89 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.160130 Jul 18 17:10:00.000392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 517/1164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:09:59 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:00.790430 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8cb4620d-2f7f-4e2f-81e7-cd3215bfcb53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:00.791042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8cb4620d-2f7f-4e2f-81e7-cd3215bfcb53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:00.797897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cb4620d-2f7f-4e2f-81e7-cd3215bfcb53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:00.798345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cb4620d-2f7f-4e2f-81e7-cd3215bfcb53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:00.799119 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cb4620d-2f7f-4e2f-81e7-cd3215bfcb53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:00.799586 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8cb4620d-2f7f-4e2f-81e7-cd3215bfcb53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:00.863059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8cb4620d-2f7f-4e2f-81e7-cd3215bfcb53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:00.871068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8cb4620d-2f7f-4e2f-81e7-cd3215bfcb53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084437 Jul 18 17:10:00.871619 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 648/1165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:00 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:01.017313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0a27bae4-5780-4868-bb6d-c09672972e1c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:01.017922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0a27bae4-5780-4868-bb6d-c09672972e1c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:01.024634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a27bae4-5780-4868-bb6d-c09672972e1c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:01.025084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a27bae4-5780-4868-bb6d-c09672972e1c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:01.025940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a27bae4-5780-4868-bb6d-c09672972e1c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:01.026383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a27bae4-5780-4868-bb6d-c09672972e1c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:01.158791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0a27bae4-5780-4868-bb6d-c09672972e1c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:01.166751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0a27bae4-5780-4868-bb6d-c09672972e1c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153373 Jul 18 17:10:01.167312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 518/1166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:01 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:01.888703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-02711b11-3403-4c28-8a21-29baffe33eb7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:01.889343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-02711b11-3403-4c28-8a21-29baffe33eb7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:01.895540 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-02711b11-3403-4c28-8a21-29baffe33eb7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:01.895986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-02711b11-3403-4c28-8a21-29baffe33eb7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:01.896787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-02711b11-3403-4c28-8a21-29baffe33eb7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:01.897219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-02711b11-3403-4c28-8a21-29baffe33eb7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:01.961833 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-02711b11-3403-4c28-8a21-29baffe33eb7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:01.970577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-02711b11-3403-4c28-8a21-29baffe33eb7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085976 Jul 18 17:10:01.971131 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 649/1167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:01 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:02.184910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-908c411f-b3d3-4849-beac-8ebb8b1d4e7c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:02.185480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-908c411f-b3d3-4849-beac-8ebb8b1d4e7c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:02.191826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-908c411f-b3d3-4849-beac-8ebb8b1d4e7c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:02.192278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-908c411f-b3d3-4849-beac-8ebb8b1d4e7c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:02.193041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-908c411f-b3d3-4849-beac-8ebb8b1d4e7c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:02.193480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-908c411f-b3d3-4849-beac-8ebb8b1d4e7c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:02.325893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-908c411f-b3d3-4849-beac-8ebb8b1d4e7c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:02.334131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-908c411f-b3d3-4849-beac-8ebb8b1d4e7c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153288 Jul 18 17:10:02.334702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 519/1168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:02 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:02.988185 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-518f43ca-6ca1-444b-9d2d-be523ea08ebd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:02.988795 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-518f43ca-6ca1-444b-9d2d-be523ea08ebd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:02.994901 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-518f43ca-6ca1-444b-9d2d-be523ea08ebd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:02.995350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-518f43ca-6ca1-444b-9d2d-be523ea08ebd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:02.996129 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-518f43ca-6ca1-444b-9d2d-be523ea08ebd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:02.996564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-518f43ca-6ca1-444b-9d2d-be523ea08ebd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:03.058312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-518f43ca-6ca1-444b-9d2d-be523ea08ebd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:03.066872 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-518f43ca-6ca1-444b-9d2d-be523ea08ebd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082472 Jul 18 17:10:03.067417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 650/1169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:02 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:03.351609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e8ea7c96-0647-4a10-b379-c846167a1ce7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:03.352205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e8ea7c96-0647-4a10-b379-c846167a1ce7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:03.354464 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=52 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:03.359310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8ea7c96-0647-4a10-b379-c846167a1ce7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:03.359781 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8ea7c96-0647-4a10-b379-c846167a1ce7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:03.360526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8ea7c96-0647-4a10-b379-c846167a1ce7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:03.360962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8ea7c96-0647-4a10-b379-c846167a1ce7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:03.495070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e8ea7c96-0647-4a10-b379-c846167a1ce7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:03.503959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e8ea7c96-0647-4a10-b379-c846167a1ce7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156246 Jul 18 17:10:03.504509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 520/1170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:03 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:04.083992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ab9fb5a3-bdf4-4d6e-b99a-c30ee06dfc1c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:04.084588 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ab9fb5a3-bdf4-4d6e-b99a-c30ee06dfc1c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:04.086514 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=56 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:04.092229 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab9fb5a3-bdf4-4d6e-b99a-c30ee06dfc1c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:04.092724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab9fb5a3-bdf4-4d6e-b99a-c30ee06dfc1c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:04.093583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab9fb5a3-bdf4-4d6e-b99a-c30ee06dfc1c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:04.094103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab9fb5a3-bdf4-4d6e-b99a-c30ee06dfc1c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:04.158044 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ab9fb5a3-bdf4-4d6e-b99a-c30ee06dfc1c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:04.165982 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ab9fb5a3-bdf4-4d6e-b99a-c30ee06dfc1c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085751 Jul 18 17:10:04.166541 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 651/1171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:04 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:04.522151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fb2f4683-5afe-420f-ac89-554c5be60bfa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:04.522760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fb2f4683-5afe-420f-ac89-554c5be60bfa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:04.529905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb2f4683-5afe-420f-ac89-554c5be60bfa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:04.530359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb2f4683-5afe-420f-ac89-554c5be60bfa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:04.531127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb2f4683-5afe-420f-ac89-554c5be60bfa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:04.531591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb2f4683-5afe-420f-ac89-554c5be60bfa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:04.661836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fb2f4683-5afe-420f-ac89-554c5be60bfa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:04.669880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fb2f4683-5afe-420f-ac89-554c5be60bfa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151870 Jul 18 17:10:04.670445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 521/1172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:04 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:05.185016 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-716cae3c-947f-4aa5-8ca2-28c3c1de4a48 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:05.185577 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-716cae3c-947f-4aa5-8ca2-28c3c1de4a48 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:05.191690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-716cae3c-947f-4aa5-8ca2-28c3c1de4a48 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:05.192140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-716cae3c-947f-4aa5-8ca2-28c3c1de4a48 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:05.192891 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-716cae3c-947f-4aa5-8ca2-28c3c1de4a48 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:05.193324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-716cae3c-947f-4aa5-8ca2-28c3c1de4a48 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:05.254112 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-716cae3c-947f-4aa5-8ca2-28c3c1de4a48 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:05.261969 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-716cae3c-947f-4aa5-8ca2-28c3c1de4a48 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081518 Jul 18 17:10:05.262531 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 652/1173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:05 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:05.687247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ac97d059-7562-41ec-a974-b3cc5ddbbb4f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:05.687879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ac97d059-7562-41ec-a974-b3cc5ddbbb4f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:05.694349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac97d059-7562-41ec-a974-b3cc5ddbbb4f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:05.694795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac97d059-7562-41ec-a974-b3cc5ddbbb4f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:05.695580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac97d059-7562-41ec-a974-b3cc5ddbbb4f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:05.696020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac97d059-7562-41ec-a974-b3cc5ddbbb4f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:05.830326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ac97d059-7562-41ec-a974-b3cc5ddbbb4f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:05.838424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ac97d059-7562-41ec-a974-b3cc5ddbbb4f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155028 Jul 18 17:10:05.839027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 522/1174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:05 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:06.278826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5d799ea2-0f3c-4295-b5b5-fc1b63cecd41 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:06.279464 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5d799ea2-0f3c-4295-b5b5-fc1b63cecd41 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:06.286079 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d799ea2-0f3c-4295-b5b5-fc1b63cecd41 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:06.286530 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d799ea2-0f3c-4295-b5b5-fc1b63cecd41 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:06.287288 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d799ea2-0f3c-4295-b5b5-fc1b63cecd41 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:06.287762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5d799ea2-0f3c-4295-b5b5-fc1b63cecd41 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:06.291764 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:06.349754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5d799ea2-0f3c-4295-b5b5-fc1b63cecd41 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:06.357804 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5d799ea2-0f3c-4295-b5b5-fc1b63cecd41 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083399 Jul 18 17:10:06.358362 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 653/1175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:06 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:06.866283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-13ef6f87-f91d-42fe-977d-095aff7635a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:06.866889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-13ef6f87-f91d-42fe-977d-095aff7635a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:06.874419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13ef6f87-f91d-42fe-977d-095aff7635a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:06.874861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13ef6f87-f91d-42fe-977d-095aff7635a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:06.875641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13ef6f87-f91d-42fe-977d-095aff7635a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:06.876075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13ef6f87-f91d-42fe-977d-095aff7635a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:07.006081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-13ef6f87-f91d-42fe-977d-095aff7635a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:07.014499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-13ef6f87-f91d-42fe-977d-095aff7635a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152134 Jul 18 17:10:07.015064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 523/1176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:06 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:07.374380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5945610b-8cd0-4dd6-af8c-5eb0c68dcea9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:07.374991 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5945610b-8cd0-4dd6-af8c-5eb0c68dcea9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:07.381044 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5945610b-8cd0-4dd6-af8c-5eb0c68dcea9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:07.381490 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5945610b-8cd0-4dd6-af8c-5eb0c68dcea9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:07.382243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5945610b-8cd0-4dd6-af8c-5eb0c68dcea9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:07.382677 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5945610b-8cd0-4dd6-af8c-5eb0c68dcea9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:07.448311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5945610b-8cd0-4dd6-af8c-5eb0c68dcea9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:07.457042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5945610b-8cd0-4dd6-af8c-5eb0c68dcea9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086852 Jul 18 17:10:07.457590 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 654/1177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:07 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:08.032131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f8629614-2ead-4e25-b5b5-ccf404220104 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:08.032742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f8629614-2ead-4e25-b5b5-ccf404220104 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:08.039269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8629614-2ead-4e25-b5b5-ccf404220104 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:08.039752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8629614-2ead-4e25-b5b5-ccf404220104 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:08.040520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8629614-2ead-4e25-b5b5-ccf404220104 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:08.041353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f8629614-2ead-4e25-b5b5-ccf404220104 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:08.170772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f8629614-2ead-4e25-b5b5-ccf404220104 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:08.179326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f8629614-2ead-4e25-b5b5-ccf404220104 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151098 Jul 18 17:10:08.179924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 524/1178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:08 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:08.474685 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e74bf326-afc2-49ea-9a7a-9a129291bcb0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:08.475929 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e74bf326-afc2-49ea-9a7a-9a129291bcb0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:08.482539 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e74bf326-afc2-49ea-9a7a-9a129291bcb0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:08.483020 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e74bf326-afc2-49ea-9a7a-9a129291bcb0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:08.483806 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e74bf326-afc2-49ea-9a7a-9a129291bcb0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:08.484250 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e74bf326-afc2-49ea-9a7a-9a129291bcb0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:08.548718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e74bf326-afc2-49ea-9a7a-9a129291bcb0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:08.557056 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e74bf326-afc2-49ea-9a7a-9a129291bcb0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086260 Jul 18 17:10:08.557616 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 655/1179] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:08 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:09.197925 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9a423093-4ad6-476b-bc03-a399d3953191 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:09.198471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9a423093-4ad6-476b-bc03-a399d3953191 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:09.205002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a423093-4ad6-476b-bc03-a399d3953191 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:09.205453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a423093-4ad6-476b-bc03-a399d3953191 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:09.206221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a423093-4ad6-476b-bc03-a399d3953191 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:09.206657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a423093-4ad6-476b-bc03-a399d3953191 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:09.338869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9a423093-4ad6-476b-bc03-a399d3953191 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:09.347683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9a423093-4ad6-476b-bc03-a399d3953191 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154071 Jul 18 17:10:09.348248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 525/1180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:09 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:09.576188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-876ec875-ad60-4357-9238-e5d303d969e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:09.576803 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-876ec875-ad60-4357-9238-e5d303d969e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:09.584385 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-876ec875-ad60-4357-9238-e5d303d969e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:09.584835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-876ec875-ad60-4357-9238-e5d303d969e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:09.585600 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-876ec875-ad60-4357-9238-e5d303d969e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:09.586036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-876ec875-ad60-4357-9238-e5d303d969e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:09.649897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-876ec875-ad60-4357-9238-e5d303d969e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:09.660396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-876ec875-ad60-4357-9238-e5d303d969e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.089988 Jul 18 17:10:09.661801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 656/1181] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:09 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:10.370291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0736511a-96f6-4fa3-af2d-a85a6d5cf255 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:10.370829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0736511a-96f6-4fa3-af2d-a85a6d5cf255 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:10.378048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0736511a-96f6-4fa3-af2d-a85a6d5cf255 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:10.378505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0736511a-96f6-4fa3-af2d-a85a6d5cf255 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:10.379266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0736511a-96f6-4fa3-af2d-a85a6d5cf255 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:10.379731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0736511a-96f6-4fa3-af2d-a85a6d5cf255 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:10.512404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0736511a-96f6-4fa3-af2d-a85a6d5cf255 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:10.520341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0736511a-96f6-4fa3-af2d-a85a6d5cf255 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154055 Jul 18 17:10:10.521109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 526/1182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:10 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:10.678393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8b57c42a-74c0-4091-936e-751ce6078b77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:10.678953 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8b57c42a-74c0-4091-936e-751ce6078b77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:10.685262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b57c42a-74c0-4091-936e-751ce6078b77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:10.685716 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b57c42a-74c0-4091-936e-751ce6078b77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:10.686506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b57c42a-74c0-4091-936e-751ce6078b77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:10.686941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b57c42a-74c0-4091-936e-751ce6078b77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:10.754534 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8b57c42a-74c0-4091-936e-751ce6078b77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:10.762585 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8b57c42a-74c0-4091-936e-751ce6078b77 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088203 Jul 18 17:10:10.763107 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 657/1183] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:10 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:11.537700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-daaf1179-03d9-424a-83de-336ca4ed5992 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:11.538287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-daaf1179-03d9-424a-83de-336ca4ed5992 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:11.545147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-daaf1179-03d9-424a-83de-336ca4ed5992 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:11.545593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-daaf1179-03d9-424a-83de-336ca4ed5992 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:11.546356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-daaf1179-03d9-424a-83de-336ca4ed5992 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:11.546797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-daaf1179-03d9-424a-83de-336ca4ed5992 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:11.549388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:11.679804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-daaf1179-03d9-424a-83de-336ca4ed5992 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:11.688388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-daaf1179-03d9-424a-83de-336ca4ed5992 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154545 Jul 18 17:10:11.688955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 527/1184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:11 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:11.779428 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e5a2edac-0d58-4240-880e-d838a11f5f01 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:11.780273 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e5a2edac-0d58-4240-880e-d838a11f5f01 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:11.786459 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5a2edac-0d58-4240-880e-d838a11f5f01 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:11.786907 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5a2edac-0d58-4240-880e-d838a11f5f01 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:11.787686 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5a2edac-0d58-4240-880e-d838a11f5f01 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:11.788180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5a2edac-0d58-4240-880e-d838a11f5f01 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:11.849358 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e5a2edac-0d58-4240-880e-d838a11f5f01 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:11.858565 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e5a2edac-0d58-4240-880e-d838a11f5f01 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082989 Jul 18 17:10:11.863126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 658/1185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:11 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:12.705920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-99e9a916-6ebe-42a2-a78b-a5b1495f71b4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:12.706543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-99e9a916-6ebe-42a2-a78b-a5b1495f71b4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:12.712989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-99e9a916-6ebe-42a2-a78b-a5b1495f71b4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:12.713427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-99e9a916-6ebe-42a2-a78b-a5b1495f71b4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:12.714176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-99e9a916-6ebe-42a2-a78b-a5b1495f71b4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:12.714608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-99e9a916-6ebe-42a2-a78b-a5b1495f71b4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:12.844666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-99e9a916-6ebe-42a2-a78b-a5b1495f71b4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:12.853024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-99e9a916-6ebe-42a2-a78b-a5b1495f71b4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150854 Jul 18 17:10:12.853595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 528/1186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:12 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:12.879542 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-98e63eeb-027d-41d7-ac81-b6752a550c3c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:12.880147 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-98e63eeb-027d-41d7-ac81-b6752a550c3c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:12.886189 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98e63eeb-027d-41d7-ac81-b6752a550c3c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:12.886623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98e63eeb-027d-41d7-ac81-b6752a550c3c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:12.887961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98e63eeb-027d-41d7-ac81-b6752a550c3c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:12.888423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-98e63eeb-027d-41d7-ac81-b6752a550c3c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:12.952397 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-98e63eeb-027d-41d7-ac81-b6752a550c3c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:12.960336 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-98e63eeb-027d-41d7-ac81-b6752a550c3c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085737 Jul 18 17:10:12.960825 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 659/1187] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:12 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:13.871391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-50466b62-d464-42f6-82c2-80b86b442317 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:13.872012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-50466b62-d464-42f6-82c2-80b86b442317 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:13.878520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50466b62-d464-42f6-82c2-80b86b442317 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:13.878965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50466b62-d464-42f6-82c2-80b86b442317 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:13.879764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50466b62-d464-42f6-82c2-80b86b442317 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:13.880198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50466b62-d464-42f6-82c2-80b86b442317 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:13.977406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c23387df-0143-4c12-80ce-143486f5c150 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:13.978360 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c23387df-0143-4c12-80ce-143486f5c150 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:13.985398 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c23387df-0143-4c12-80ce-143486f5c150 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:13.985844 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c23387df-0143-4c12-80ce-143486f5c150 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:13.986615 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c23387df-0143-4c12-80ce-143486f5c150 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:13.987048 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c23387df-0143-4c12-80ce-143486f5c150 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:14.014990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-50466b62-d464-42f6-82c2-80b86b442317 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:14.024076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-50466b62-d464-42f6-82c2-80b86b442317 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156501 Jul 18 17:10:14.024663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 529/1188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:13 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:14.048707 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c23387df-0143-4c12-80ce-143486f5c150 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:14.057185 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c23387df-0143-4c12-80ce-143486f5c150 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083583 Jul 18 17:10:14.057743 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 660/1189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:13 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:15.042099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-18eadb47-7d70-4cb7-9570-bee6f24f9f22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:15.042716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-18eadb47-7d70-4cb7-9570-bee6f24f9f22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:15.049517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18eadb47-7d70-4cb7-9570-bee6f24f9f22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:15.050228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18eadb47-7d70-4cb7-9570-bee6f24f9f22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:15.050995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18eadb47-7d70-4cb7-9570-bee6f24f9f22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:15.051432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18eadb47-7d70-4cb7-9570-bee6f24f9f22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:15.074106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-761db472-8b57-40ef-9bed-ddb8b93851a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:15.074692 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-761db472-8b57-40ef-9bed-ddb8b93851a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:15.081708 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-761db472-8b57-40ef-9bed-ddb8b93851a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:15.082153 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-761db472-8b57-40ef-9bed-ddb8b93851a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:15.082914 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-761db472-8b57-40ef-9bed-ddb8b93851a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:15.083349 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-761db472-8b57-40ef-9bed-ddb8b93851a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:15.146339 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-761db472-8b57-40ef-9bed-ddb8b93851a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:15.154496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-761db472-8b57-40ef-9bed-ddb8b93851a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084163 Jul 18 17:10:15.155174 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 661/1190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:15 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:15.184241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-18eadb47-7d70-4cb7-9570-bee6f24f9f22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:15.192769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-18eadb47-7d70-4cb7-9570-bee6f24f9f22 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154693 Jul 18 17:10:15.193330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 530/1191] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:15 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:16.172370 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-63017d6d-4980-47e0-9773-3f32d4149c45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:16.172903 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-63017d6d-4980-47e0-9773-3f32d4149c45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:16.179312 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63017d6d-4980-47e0-9773-3f32d4149c45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:16.179782 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63017d6d-4980-47e0-9773-3f32d4149c45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:16.180549 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63017d6d-4980-47e0-9773-3f32d4149c45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:16.180984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63017d6d-4980-47e0-9773-3f32d4149c45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:16.210887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a0b04f5b-b469-4a68-bf2f-b3db2545dca1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:16.211554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a0b04f5b-b469-4a68-bf2f-b3db2545dca1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:16.219346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a0b04f5b-b469-4a68-bf2f-b3db2545dca1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:16.219884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a0b04f5b-b469-4a68-bf2f-b3db2545dca1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:16.220665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a0b04f5b-b469-4a68-bf2f-b3db2545dca1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:16.221108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a0b04f5b-b469-4a68-bf2f-b3db2545dca1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:16.246131 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-63017d6d-4980-47e0-9773-3f32d4149c45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:16.259106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-63017d6d-4980-47e0-9773-3f32d4149c45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.091046 Jul 18 17:10:16.260075 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 662/1192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:16 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:16.368586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a0b04f5b-b469-4a68-bf2f-b3db2545dca1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:16.376816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a0b04f5b-b469-4a68-bf2f-b3db2545dca1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.169924 Jul 18 17:10:16.377378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 531/1193] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:16 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:17.282452 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ddb49c38-8b4a-4091-acc6-6eb7493b0edd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:17.283086 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ddb49c38-8b4a-4091-acc6-6eb7493b0edd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:17.289090 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ddb49c38-8b4a-4091-acc6-6eb7493b0edd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:17.289530 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ddb49c38-8b4a-4091-acc6-6eb7493b0edd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:17.290317 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ddb49c38-8b4a-4091-acc6-6eb7493b0edd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:17.290746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ddb49c38-8b4a-4091-acc6-6eb7493b0edd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:17.354836 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ddb49c38-8b4a-4091-acc6-6eb7493b0edd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:17.362978 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ddb49c38-8b4a-4091-acc6-6eb7493b0edd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085086 Jul 18 17:10:17.363562 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 663/1194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:17 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:17.394769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1ba480a1-bcd4-47a3-98db-9af03124abb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:17.395387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1ba480a1-bcd4-47a3-98db-9af03124abb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:17.401867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1ba480a1-bcd4-47a3-98db-9af03124abb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:17.402316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1ba480a1-bcd4-47a3-98db-9af03124abb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:17.403077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1ba480a1-bcd4-47a3-98db-9af03124abb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:17.403537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1ba480a1-bcd4-47a3-98db-9af03124abb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:17.545851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1ba480a1-bcd4-47a3-98db-9af03124abb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:17.554638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1ba480a1-bcd4-47a3-98db-9af03124abb6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.163769 Jul 18 17:10:17.555211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 532/1195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:17 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:18.379861 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4822817a-3f71-42df-ae56-3da266ef0db9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:18.380469 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4822817a-3f71-42df-ae56-3da266ef0db9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:18.386408 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4822817a-3f71-42df-ae56-3da266ef0db9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:18.386844 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4822817a-3f71-42df-ae56-3da266ef0db9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:18.387630 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4822817a-3f71-42df-ae56-3da266ef0db9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:18.388059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4822817a-3f71-42df-ae56-3da266ef0db9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:18.451966 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4822817a-3f71-42df-ae56-3da266ef0db9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:18.459875 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4822817a-3f71-42df-ae56-3da266ef0db9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083808 Jul 18 17:10:18.460429 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 664/1196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:18 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:18.572401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0b51e9ba-fa26-4ca5-8ccd-25c56d73dfb8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:18.573018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0b51e9ba-fa26-4ca5-8ccd-25c56d73dfb8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:18.580236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b51e9ba-fa26-4ca5-8ccd-25c56d73dfb8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:18.580674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b51e9ba-fa26-4ca5-8ccd-25c56d73dfb8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:18.581425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b51e9ba-fa26-4ca5-8ccd-25c56d73dfb8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:18.581859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b51e9ba-fa26-4ca5-8ccd-25c56d73dfb8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:18.713309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0b51e9ba-fa26-4ca5-8ccd-25c56d73dfb8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:18.722475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0b51e9ba-fa26-4ca5-8ccd-25c56d73dfb8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153868 Jul 18 17:10:18.723052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 533/1197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:18 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:19.476558 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ddf2a277-19f9-4110-aa10-72d809f2614d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:19.477172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ddf2a277-19f9-4110-aa10-72d809f2614d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:19.483837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ddf2a277-19f9-4110-aa10-72d809f2614d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:19.484300 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ddf2a277-19f9-4110-aa10-72d809f2614d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:19.485045 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ddf2a277-19f9-4110-aa10-72d809f2614d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:19.485477 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ddf2a277-19f9-4110-aa10-72d809f2614d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:19.546556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ddf2a277-19f9-4110-aa10-72d809f2614d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:19.554974 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ddf2a277-19f9-4110-aa10-72d809f2614d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082227 Jul 18 17:10:19.555548 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 665/1198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:19 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:19.739986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-88073b4d-3265-4868-9772-3f4941d61aed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:19.740512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-88073b4d-3265-4868-9772-3f4941d61aed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:19.747016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88073b4d-3265-4868-9772-3f4941d61aed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:19.747457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88073b4d-3265-4868-9772-3f4941d61aed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:19.748346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88073b4d-3265-4868-9772-3f4941d61aed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:19.748770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88073b4d-3265-4868-9772-3f4941d61aed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:19.885209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-88073b4d-3265-4868-9772-3f4941d61aed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:19.893489 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-88073b4d-3265-4868-9772-3f4941d61aed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157454 Jul 18 17:10:19.894058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 534/1199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:19 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:20.572702 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1a18a476-64e9-450d-a289-2f88a636df53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:20.573306 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1a18a476-64e9-450d-a289-2f88a636df53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:20.580402 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a18a476-64e9-450d-a289-2f88a636df53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:20.580788 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a18a476-64e9-450d-a289-2f88a636df53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:20.581543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a18a476-64e9-450d-a289-2f88a636df53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:20.581974 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1a18a476-64e9-450d-a289-2f88a636df53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:20.642653 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1a18a476-64e9-450d-a289-2f88a636df53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:20.650769 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1a18a476-64e9-450d-a289-2f88a636df53 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082051 Jul 18 17:10:20.651321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 666/1200] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:20 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:20.911858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4b79b047-8e86-4ae8-bdb2-fb2f9a5f7ed7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:20.912485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4b79b047-8e86-4ae8-bdb2-fb2f9a5f7ed7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:20.919054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b79b047-8e86-4ae8-bdb2-fb2f9a5f7ed7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:20.919507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b79b047-8e86-4ae8-bdb2-fb2f9a5f7ed7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:20.920309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b79b047-8e86-4ae8-bdb2-fb2f9a5f7ed7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:20.920863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b79b047-8e86-4ae8-bdb2-fb2f9a5f7ed7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:21.053598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4b79b047-8e86-4ae8-bdb2-fb2f9a5f7ed7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:21.061694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4b79b047-8e86-4ae8-bdb2-fb2f9a5f7ed7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154140 Jul 18 17:10:21.062252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 535/1201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:20 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:21.668200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-79252c5e-8a48-465c-9da0-538a516a0f52 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:21.668826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-79252c5e-8a48-465c-9da0-538a516a0f52 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:21.675682 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-79252c5e-8a48-465c-9da0-538a516a0f52 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:21.676132 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-79252c5e-8a48-465c-9da0-538a516a0f52 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:21.676881 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-79252c5e-8a48-465c-9da0-538a516a0f52 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:21.677313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-79252c5e-8a48-465c-9da0-538a516a0f52 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:21.740505 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-79252c5e-8a48-465c-9da0-538a516a0f52 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:21.748463 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-79252c5e-8a48-465c-9da0-538a516a0f52 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084081 Jul 18 17:10:21.749614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 667/1202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:22.078143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1d551346-869f-4478-abe6-bc2adab45641 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:22.078753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1d551346-869f-4478-abe6-bc2adab45641 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:22.085687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1d551346-869f-4478-abe6-bc2adab45641 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:22.086139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1d551346-869f-4478-abe6-bc2adab45641 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:22.086911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1d551346-869f-4478-abe6-bc2adab45641 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:22.087725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1d551346-869f-4478-abe6-bc2adab45641 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:22.221433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1d551346-869f-4478-abe6-bc2adab45641 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:22.230329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1d551346-869f-4478-abe6-bc2adab45641 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155999 Jul 18 17:10:22.230911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 536/1203] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:22 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:22.765883 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-547a6eae-ea76-467e-be50-04e930c1a459 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:22.766471 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-547a6eae-ea76-467e-be50-04e930c1a459 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:22.773406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-547a6eae-ea76-467e-be50-04e930c1a459 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:22.773844 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-547a6eae-ea76-467e-be50-04e930c1a459 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:22.774589 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-547a6eae-ea76-467e-be50-04e930c1a459 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:22.775012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-547a6eae-ea76-467e-be50-04e930c1a459 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:22.835987 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-547a6eae-ea76-467e-be50-04e930c1a459 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:22.843873 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-547a6eae-ea76-467e-be50-04e930c1a459 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081764 Jul 18 17:10:22.844431 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 668/1204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:23.248896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-27ba0834-f763-4093-b508-243f6038fac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:23.250934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-27ba0834-f763-4093-b508-243f6038fac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:23.256884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27ba0834-f763-4093-b508-243f6038fac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:23.257324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27ba0834-f763-4093-b508-243f6038fac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:23.258095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27ba0834-f763-4093-b508-243f6038fac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:23.258528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27ba0834-f763-4093-b508-243f6038fac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:23.387920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-27ba0834-f763-4093-b508-243f6038fac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:23.396610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-27ba0834-f763-4093-b508-243f6038fac8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151811 Jul 18 17:10:23.397166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 537/1205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:23 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:23.861157 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1c7ebebc-2760-4ddd-af54-dc40f843f2b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:23.861755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1c7ebebc-2760-4ddd-af54-dc40f843f2b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:23.868689 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1c7ebebc-2760-4ddd-af54-dc40f843f2b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:23.869124 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1c7ebebc-2760-4ddd-af54-dc40f843f2b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:23.869872 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1c7ebebc-2760-4ddd-af54-dc40f843f2b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:23.870298 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1c7ebebc-2760-4ddd-af54-dc40f843f2b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:23.931902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1c7ebebc-2760-4ddd-af54-dc40f843f2b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:23.934091 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:23.941631 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1c7ebebc-2760-4ddd-af54-dc40f843f2b6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083017 Jul 18 17:10:23.949110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 669/1206] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:23 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:24.414079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fb3a3e54-1ad2-4449-a449-2f19749996bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:24.414689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fb3a3e54-1ad2-4449-a449-2f19749996bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:24.421300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb3a3e54-1ad2-4449-a449-2f19749996bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:24.421746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb3a3e54-1ad2-4449-a449-2f19749996bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:24.422501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb3a3e54-1ad2-4449-a449-2f19749996bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:24.422936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb3a3e54-1ad2-4449-a449-2f19749996bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:24.552014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fb3a3e54-1ad2-4449-a449-2f19749996bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:24.563126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fb3a3e54-1ad2-4449-a449-2f19749996bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152428 Jul 18 17:10:24.564185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 538/1207] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:24 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:24.958956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9a0fba7e-fb61-41a2-88a1-bcf339f5c85c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:24.959595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9a0fba7e-fb61-41a2-88a1-bcf339f5c85c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:24.965784 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9a0fba7e-fb61-41a2-88a1-bcf339f5c85c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:24.966236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9a0fba7e-fb61-41a2-88a1-bcf339f5c85c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:24.966987 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9a0fba7e-fb61-41a2-88a1-bcf339f5c85c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:24.967426 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9a0fba7e-fb61-41a2-88a1-bcf339f5c85c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:25.028393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9a0fba7e-fb61-41a2-88a1-bcf339f5c85c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:25.036886 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9a0fba7e-fb61-41a2-88a1-bcf339f5c85c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082223 Jul 18 17:10:25.037474 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 670/1208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:25.582105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-55c0dfed-325a-409f-84fb-2fd8e6fe977a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:25.582714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-55c0dfed-325a-409f-84fb-2fd8e6fe977a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:25.589292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-55c0dfed-325a-409f-84fb-2fd8e6fe977a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:25.589743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-55c0dfed-325a-409f-84fb-2fd8e6fe977a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:25.590502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-55c0dfed-325a-409f-84fb-2fd8e6fe977a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:25.590941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-55c0dfed-325a-409f-84fb-2fd8e6fe977a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:25.727553 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-55c0dfed-325a-409f-84fb-2fd8e6fe977a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:25.735503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-55c0dfed-325a-409f-84fb-2fd8e6fe977a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.158053 Jul 18 17:10:25.736069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 539/1209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:25 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:25.869663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:10:25.869843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:10:26.054779 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1d92d29d-df81-47a2-bb46-39cda47ef9b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:26.055388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1d92d29d-df81-47a2-bb46-39cda47ef9b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:26.061610 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1d92d29d-df81-47a2-bb46-39cda47ef9b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:26.062063 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1d92d29d-df81-47a2-bb46-39cda47ef9b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:26.062821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1d92d29d-df81-47a2-bb46-39cda47ef9b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:26.063256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1d92d29d-df81-47a2-bb46-39cda47ef9b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:26.129291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1d92d29d-df81-47a2-bb46-39cda47ef9b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:26.137399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1d92d29d-df81-47a2-bb46-39cda47ef9b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086660 Jul 18 17:10:26.137961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 671/1210] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:26.752819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9b1ed171-d3e0-45f9-aa4d-f695f2b2a8cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:26.753447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9b1ed171-d3e0-45f9-aa4d-f695f2b2a8cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:26.759965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b1ed171-d3e0-45f9-aa4d-f695f2b2a8cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:26.760404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b1ed171-d3e0-45f9-aa4d-f695f2b2a8cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:26.761157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b1ed171-d3e0-45f9-aa4d-f695f2b2a8cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:26.761586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b1ed171-d3e0-45f9-aa4d-f695f2b2a8cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:26.895229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9b1ed171-d3e0-45f9-aa4d-f695f2b2a8cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:26.903382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9b1ed171-d3e0-45f9-aa4d-f695f2b2a8cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154493 Jul 18 17:10:26.903961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 540/1211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:26 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:27.154138 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7a57f108-b962-4517-9f37-e09ec3dc95ad tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:27.154754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7a57f108-b962-4517-9f37-e09ec3dc95ad tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:27.161396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a57f108-b962-4517-9f37-e09ec3dc95ad tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:27.161838 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a57f108-b962-4517-9f37-e09ec3dc95ad tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:27.162586 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a57f108-b962-4517-9f37-e09ec3dc95ad tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:27.163022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7a57f108-b962-4517-9f37-e09ec3dc95ad tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:27.223261 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7a57f108-b962-4517-9f37-e09ec3dc95ad tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:27.231222 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7a57f108-b962-4517-9f37-e09ec3dc95ad tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.080976 Jul 18 17:10:27.231821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 672/1212] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:27.921443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-03b30c68-ee40-4a9f-b4d3-acb599deef6d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:27.922069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-03b30c68-ee40-4a9f-b4d3-acb599deef6d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:27.929600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03b30c68-ee40-4a9f-b4d3-acb599deef6d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:27.930056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03b30c68-ee40-4a9f-b4d3-acb599deef6d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:27.930862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03b30c68-ee40-4a9f-b4d3-acb599deef6d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:27.931302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03b30c68-ee40-4a9f-b4d3-acb599deef6d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:28.065381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-03b30c68-ee40-4a9f-b4d3-acb599deef6d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:28.073389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-03b30c68-ee40-4a9f-b4d3-acb599deef6d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155784 Jul 18 17:10:28.073941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 541/1213] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:27 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:28.248992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b6e6e34c-1ae7-45ec-83ad-ff1f5ef4c899 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:28.249635 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b6e6e34c-1ae7-45ec-83ad-ff1f5ef4c899 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:28.255798 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b6e6e34c-1ae7-45ec-83ad-ff1f5ef4c899 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:28.256239 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b6e6e34c-1ae7-45ec-83ad-ff1f5ef4c899 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:28.256982 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b6e6e34c-1ae7-45ec-83ad-ff1f5ef4c899 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:28.257410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b6e6e34c-1ae7-45ec-83ad-ff1f5ef4c899 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:28.318758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b6e6e34c-1ae7-45ec-83ad-ff1f5ef4c899 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:28.326783 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b6e6e34c-1ae7-45ec-83ad-ff1f5ef4c899 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081880 Jul 18 17:10:28.327329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 673/1214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:28 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:29.090426 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a8676a30-17d2-466d-8cf0-3b5d3f3ffd77 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:29.090978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a8676a30-17d2-466d-8cf0-3b5d3f3ffd77 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:29.097676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8676a30-17d2-466d-8cf0-3b5d3f3ffd77 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:29.098127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8676a30-17d2-466d-8cf0-3b5d3f3ffd77 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:29.098895 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8676a30-17d2-466d-8cf0-3b5d3f3ffd77 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:29.099335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8676a30-17d2-466d-8cf0-3b5d3f3ffd77 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:29.227441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a8676a30-17d2-466d-8cf0-3b5d3f3ffd77 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:29.235381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a8676a30-17d2-466d-8cf0-3b5d3f3ffd77 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.149030 Jul 18 17:10:29.235967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 542/1215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:29 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:29.343380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-03b224c0-d4f3-4d4e-b0d3-fc5912ed51e8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:29.343942 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-03b224c0-d4f3-4d4e-b0d3-fc5912ed51e8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:29.350118 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03b224c0-d4f3-4d4e-b0d3-fc5912ed51e8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:29.350555 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03b224c0-d4f3-4d4e-b0d3-fc5912ed51e8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:29.351297 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03b224c0-d4f3-4d4e-b0d3-fc5912ed51e8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:29.351749 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-03b224c0-d4f3-4d4e-b0d3-fc5912ed51e8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:29.411423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-03b224c0-d4f3-4d4e-b0d3-fc5912ed51e8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:29.419213 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-03b224c0-d4f3-4d4e-b0d3-fc5912ed51e8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.079720 Jul 18 17:10:29.419799 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 674/1216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:29 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:30.252777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a624fa92-c9d5-4405-8870-ebdc1f9d725e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:30.253992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a624fa92-c9d5-4405-8870-ebdc1f9d725e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:30.260602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a624fa92-c9d5-4405-8870-ebdc1f9d725e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:30.261040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a624fa92-c9d5-4405-8870-ebdc1f9d725e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:30.261815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a624fa92-c9d5-4405-8870-ebdc1f9d725e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:30.262245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a624fa92-c9d5-4405-8870-ebdc1f9d725e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:30.394197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a624fa92-c9d5-4405-8870-ebdc1f9d725e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:30.396476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:30.402739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a624fa92-c9d5-4405-8870-ebdc1f9d725e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153814 Jul 18 17:10:30.403298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 543/1217] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:30 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:30.436851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6308ea2f-2e11-421e-8135-c12217da32f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:30.437458 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6308ea2f-2e11-421e-8135-c12217da32f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:30.444177 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6308ea2f-2e11-421e-8135-c12217da32f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:30.444538 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6308ea2f-2e11-421e-8135-c12217da32f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:30.445291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6308ea2f-2e11-421e-8135-c12217da32f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:30.445732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6308ea2f-2e11-421e-8135-c12217da32f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:30.508046 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6308ea2f-2e11-421e-8135-c12217da32f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:30.516126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6308ea2f-2e11-421e-8135-c12217da32f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083168 Jul 18 17:10:30.516690 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 675/1218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:31.420989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a5b4b588-185b-4c62-96a5-dea548a960c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:31.421593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a5b4b588-185b-4c62-96a5-dea548a960c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:31.428636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5b4b588-185b-4c62-96a5-dea548a960c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:31.429088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5b4b588-185b-4c62-96a5-dea548a960c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:31.429857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5b4b588-185b-4c62-96a5-dea548a960c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:31.430296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5b4b588-185b-4c62-96a5-dea548a960c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:31.532842 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8b8d11b0-bfb7-410c-b01b-b6861dc95b54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:31.533550 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8b8d11b0-bfb7-410c-b01b-b6861dc95b54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:31.539767 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b8d11b0-bfb7-410c-b01b-b6861dc95b54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:31.540290 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b8d11b0-bfb7-410c-b01b-b6861dc95b54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:31.541113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b8d11b0-bfb7-410c-b01b-b6861dc95b54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:31.541612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8b8d11b0-bfb7-410c-b01b-b6861dc95b54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:31.564609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a5b4b588-185b-4c62-96a5-dea548a960c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:31.573959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a5b4b588-185b-4c62-96a5-dea548a960c1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157108 Jul 18 17:10:31.574523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 544/1219] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:31 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:31.602343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8b8d11b0-bfb7-410c-b01b-b6861dc95b54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:31.610261 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8b8d11b0-bfb7-410c-b01b-b6861dc95b54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081224 Jul 18 17:10:31.610807 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 676/1220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:32.591522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f32c649c-b823-4bb7-ac8a-4deb39c00c2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:32.592131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f32c649c-b823-4bb7-ac8a-4deb39c00c2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:32.599660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f32c649c-b823-4bb7-ac8a-4deb39c00c2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:32.600108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f32c649c-b823-4bb7-ac8a-4deb39c00c2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:32.600870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f32c649c-b823-4bb7-ac8a-4deb39c00c2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:32.601308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f32c649c-b823-4bb7-ac8a-4deb39c00c2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:32.627134 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a8ed5e5f-6d92-4eda-adfe-5e86fc8cd434 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:32.628329 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a8ed5e5f-6d92-4eda-adfe-5e86fc8cd434 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:32.634654 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8ed5e5f-6d92-4eda-adfe-5e86fc8cd434 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:32.635102 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8ed5e5f-6d92-4eda-adfe-5e86fc8cd434 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:32.635884 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8ed5e5f-6d92-4eda-adfe-5e86fc8cd434 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:32.636327 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a8ed5e5f-6d92-4eda-adfe-5e86fc8cd434 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:32.698935 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a8ed5e5f-6d92-4eda-adfe-5e86fc8cd434 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:32.707691 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a8ed5e5f-6d92-4eda-adfe-5e86fc8cd434 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084404 Jul 18 17:10:32.708256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 677/1221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:32.737394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f32c649c-b823-4bb7-ac8a-4deb39c00c2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:32.745569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f32c649c-b823-4bb7-ac8a-4deb39c00c2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157851 Jul 18 17:10:32.746132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 545/1222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:32 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:33.724797 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d7ce3ee3-cd06-4b92-be9d-a7a946a5a4e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:33.725406 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d7ce3ee3-cd06-4b92-be9d-a7a946a5a4e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:33.731876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d7ce3ee3-cd06-4b92-be9d-a7a946a5a4e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:33.732331 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d7ce3ee3-cd06-4b92-be9d-a7a946a5a4e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:33.733087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d7ce3ee3-cd06-4b92-be9d-a7a946a5a4e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:33.733525 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d7ce3ee3-cd06-4b92-be9d-a7a946a5a4e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:33.763134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0b088bd2-39db-4b43-9129-209312658cd0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:33.765242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0b088bd2-39db-4b43-9129-209312658cd0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:33.767641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=52 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:33.773194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b088bd2-39db-4b43-9129-209312658cd0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:33.773640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b088bd2-39db-4b43-9129-209312658cd0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:33.774409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b088bd2-39db-4b43-9129-209312658cd0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:33.774845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b088bd2-39db-4b43-9129-209312658cd0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:33.796601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d7ce3ee3-cd06-4b92-be9d-a7a946a5a4e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:33.805184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d7ce3ee3-cd06-4b92-be9d-a7a946a5a4e1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084770 Jul 18 17:10:33.805753 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 678/1223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:33 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:33.912135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0b088bd2-39db-4b43-9129-209312658cd0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:33.920042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0b088bd2-39db-4b43-9129-209312658cd0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.160643 Jul 18 17:10:33.920595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 546/1224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:33 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:34.821992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2098364b-f3a6-4319-9c00-cfaedddf0ba2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:34.822586 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2098364b-f3a6-4319-9c00-cfaedddf0ba2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:34.824491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=56 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:34.829275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2098364b-f3a6-4319-9c00-cfaedddf0ba2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:34.829719 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2098364b-f3a6-4319-9c00-cfaedddf0ba2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:34.830477 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2098364b-f3a6-4319-9c00-cfaedddf0ba2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:34.831472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2098364b-f3a6-4319-9c00-cfaedddf0ba2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:34.896421 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2098364b-f3a6-4319-9c00-cfaedddf0ba2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:34.904282 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2098364b-f3a6-4319-9c00-cfaedddf0ba2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086095 Jul 18 17:10:34.904839 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 679/1225] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:34 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:34.936241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5bca58fd-f83a-477f-bc80-383ad4a5f74b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:34.936839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5bca58fd-f83a-477f-bc80-383ad4a5f74b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:34.943767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bca58fd-f83a-477f-bc80-383ad4a5f74b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:34.944215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bca58fd-f83a-477f-bc80-383ad4a5f74b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:34.944968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bca58fd-f83a-477f-bc80-383ad4a5f74b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:34.945401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bca58fd-f83a-477f-bc80-383ad4a5f74b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:35.075318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5bca58fd-f83a-477f-bc80-383ad4a5f74b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:35.084006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5bca58fd-f83a-477f-bc80-383ad4a5f74b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151431 Jul 18 17:10:35.084566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 547/1226] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:34 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:35.921340 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e07ff7e6-7221-4839-b427-967db485ddcb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:35.921920 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e07ff7e6-7221-4839-b427-967db485ddcb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:35.929899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e07ff7e6-7221-4839-b427-967db485ddcb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:35.930350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e07ff7e6-7221-4839-b427-967db485ddcb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:35.931106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e07ff7e6-7221-4839-b427-967db485ddcb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:35.931570 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e07ff7e6-7221-4839-b427-967db485ddcb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:35.995110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e07ff7e6-7221-4839-b427-967db485ddcb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:36.003393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e07ff7e6-7221-4839-b427-967db485ddcb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085874 Jul 18 17:10:36.004514 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 680/1227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:36.101269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-aafbce97-435f-4958-b29e-7364fc554c3f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:36.101845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-aafbce97-435f-4958-b29e-7364fc554c3f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:36.108374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aafbce97-435f-4958-b29e-7364fc554c3f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:36.108821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aafbce97-435f-4958-b29e-7364fc554c3f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:36.109585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aafbce97-435f-4958-b29e-7364fc554c3f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:36.110027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aafbce97-435f-4958-b29e-7364fc554c3f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:36.254371 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-aafbce97-435f-4958-b29e-7364fc554c3f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:36.262641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-aafbce97-435f-4958-b29e-7364fc554c3f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.165446 Jul 18 17:10:36.263206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 548/1228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:36 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:37.022426 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dcb824ce-c2b8-41de-9ec5-572bb7d865fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:37.023073 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dcb824ce-c2b8-41de-9ec5-572bb7d865fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:37.029851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dcb824ce-c2b8-41de-9ec5-572bb7d865fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:37.030302 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dcb824ce-c2b8-41de-9ec5-572bb7d865fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:37.031077 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dcb824ce-c2b8-41de-9ec5-572bb7d865fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:37.031540 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dcb824ce-c2b8-41de-9ec5-572bb7d865fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:37.095473 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dcb824ce-c2b8-41de-9ec5-572bb7d865fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:37.104005 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dcb824ce-c2b8-41de-9ec5-572bb7d865fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086353 Jul 18 17:10:37.104567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 681/1229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:37 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:37.279932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5998c972-901c-4d68-bd7a-7bfe71e58401 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:37.280539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5998c972-901c-4d68-bd7a-7bfe71e58401 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:37.287708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5998c972-901c-4d68-bd7a-7bfe71e58401 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:37.288158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5998c972-901c-4d68-bd7a-7bfe71e58401 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:37.288918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5998c972-901c-4d68-bd7a-7bfe71e58401 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:37.289354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5998c972-901c-4d68-bd7a-7bfe71e58401 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:37.420235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5998c972-901c-4d68-bd7a-7bfe71e58401 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:37.431653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5998c972-901c-4d68-bd7a-7bfe71e58401 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152977 Jul 18 17:10:37.431653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 549/1230] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:37 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:38.121547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3b809708-c548-4121-85c4-41d91581fcc2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:38.122090 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3b809708-c548-4121-85c4-41d91581fcc2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:38.128133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3b809708-c548-4121-85c4-41d91581fcc2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:38.128635 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3b809708-c548-4121-85c4-41d91581fcc2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:38.129392 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3b809708-c548-4121-85c4-41d91581fcc2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:38.129829 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3b809708-c548-4121-85c4-41d91581fcc2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:38.334898 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3b809708-c548-4121-85c4-41d91581fcc2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:38.342813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3b809708-c548-4121-85c4-41d91581fcc2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.225191 Jul 18 17:10:38.343374 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 682/1231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:38 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:38.446777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1e81b749-56d3-4b6e-9da3-0f269fc4bc39 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:38.448479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1e81b749-56d3-4b6e-9da3-0f269fc4bc39 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:38.459063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e81b749-56d3-4b6e-9da3-0f269fc4bc39 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:38.459536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e81b749-56d3-4b6e-9da3-0f269fc4bc39 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:38.460335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e81b749-56d3-4b6e-9da3-0f269fc4bc39 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:38.460809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e81b749-56d3-4b6e-9da3-0f269fc4bc39 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:38.591243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1e81b749-56d3-4b6e-9da3-0f269fc4bc39 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:38.600286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1e81b749-56d3-4b6e-9da3-0f269fc4bc39 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157412 Jul 18 17:10:38.600845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 550/1232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:38 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:39.359858 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3102c4c9-8fd1-4f4c-b03d-f07ba9899e31 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:39.360460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3102c4c9-8fd1-4f4c-b03d-f07ba9899e31 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:39.367158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3102c4c9-8fd1-4f4c-b03d-f07ba9899e31 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:39.367628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3102c4c9-8fd1-4f4c-b03d-f07ba9899e31 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:39.368388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3102c4c9-8fd1-4f4c-b03d-f07ba9899e31 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:39.368820 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3102c4c9-8fd1-4f4c-b03d-f07ba9899e31 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:39.618703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-14134efe-e24e-4063-914f-63e473f3c17b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:39.619293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-14134efe-e24e-4063-914f-63e473f3c17b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:39.626521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14134efe-e24e-4063-914f-63e473f3c17b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:39.626964 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14134efe-e24e-4063-914f-63e473f3c17b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:39.627851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14134efe-e24e-4063-914f-63e473f3c17b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:39.628900 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14134efe-e24e-4063-914f-63e473f3c17b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:39.676057 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3102c4c9-8fd1-4f4c-b03d-f07ba9899e31 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:39.684148 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3102c4c9-8fd1-4f4c-b03d-f07ba9899e31 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.328012 Jul 18 17:10:39.684711 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 683/1233] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:39 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:39.767886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-14134efe-e24e-4063-914f-63e473f3c17b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:39.776347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-14134efe-e24e-4063-914f-63e473f3c17b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.161994 Jul 18 17:10:39.776910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 551/1234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:39 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:40.701658 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-efaa307c-5372-4036-a384-f10c32dd0fbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:40.702200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-efaa307c-5372-4036-a384-f10c32dd0fbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:40.709007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efaa307c-5372-4036-a384-f10c32dd0fbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:40.709454 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efaa307c-5372-4036-a384-f10c32dd0fbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:40.710240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efaa307c-5372-4036-a384-f10c32dd0fbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:40.710676 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-efaa307c-5372-4036-a384-f10c32dd0fbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:40.773511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-efaa307c-5372-4036-a384-f10c32dd0fbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:40.781345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-efaa307c-5372-4036-a384-f10c32dd0fbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083690 Jul 18 17:10:40.781879 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 684/1235] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:40 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:40.793331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2fe7d941-28db-40c9-bf47-578c7f87de2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:40.793935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2fe7d941-28db-40c9-bf47-578c7f87de2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:40.802045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2fe7d941-28db-40c9-bf47-578c7f87de2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:40.802483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2fe7d941-28db-40c9-bf47-578c7f87de2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:40.803243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2fe7d941-28db-40c9-bf47-578c7f87de2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:40.803701 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2fe7d941-28db-40c9-bf47-578c7f87de2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:40.937613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2fe7d941-28db-40c9-bf47-578c7f87de2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:40.946189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2fe7d941-28db-40c9-bf47-578c7f87de2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156556 Jul 18 17:10:40.946751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 552/1236] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:40 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:41.798176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b72baa54-6895-4dfc-89a5-a6b3147bc86f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:41.798764 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b72baa54-6895-4dfc-89a5-a6b3147bc86f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:41.805721 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b72baa54-6895-4dfc-89a5-a6b3147bc86f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:41.806187 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b72baa54-6895-4dfc-89a5-a6b3147bc86f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:41.806925 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b72baa54-6895-4dfc-89a5-a6b3147bc86f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:41.807355 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b72baa54-6895-4dfc-89a5-a6b3147bc86f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:41.872608 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b72baa54-6895-4dfc-89a5-a6b3147bc86f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:41.881126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b72baa54-6895-4dfc-89a5-a6b3147bc86f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086724 Jul 18 17:10:41.881685 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 685/1237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:41 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:41.963346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-84c357be-510d-4dca-ab94-f0940b203d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:41.964036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-84c357be-510d-4dca-ab94-f0940b203d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:41.970512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-84c357be-510d-4dca-ab94-f0940b203d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:41.975527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-84c357be-510d-4dca-ab94-f0940b203d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:41.975527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-84c357be-510d-4dca-ab94-f0940b203d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:41.975527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-84c357be-510d-4dca-ab94-f0940b203d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:42.105246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-84c357be-510d-4dca-ab94-f0940b203d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:42.114319 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-84c357be-510d-4dca-ab94-f0940b203d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154852 Jul 18 17:10:42.114878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 553/1238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:41 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:42.898144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ba27acb2-5e16-4a5c-81c6-02b7c1601152 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:42.898769 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ba27acb2-5e16-4a5c-81c6-02b7c1601152 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:42.905023 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba27acb2-5e16-4a5c-81c6-02b7c1601152 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:42.905472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba27acb2-5e16-4a5c-81c6-02b7c1601152 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:42.906226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba27acb2-5e16-4a5c-81c6-02b7c1601152 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:42.906660 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba27acb2-5e16-4a5c-81c6-02b7c1601152 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:42.921410 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:42.968583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ba27acb2-5e16-4a5c-81c6-02b7c1601152 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:42.976822 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ba27acb2-5e16-4a5c-81c6-02b7c1601152 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082600 Jul 18 17:10:42.977367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 686/1239] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:42 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:43.131590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-28e0bf4b-653c-4021-9e98-bc82fa3a28cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:43.132289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-28e0bf4b-653c-4021-9e98-bc82fa3a28cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:43.138747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-28e0bf4b-653c-4021-9e98-bc82fa3a28cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:43.139197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-28e0bf4b-653c-4021-9e98-bc82fa3a28cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:43.139994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-28e0bf4b-653c-4021-9e98-bc82fa3a28cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:43.140440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-28e0bf4b-653c-4021-9e98-bc82fa3a28cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:43.270387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-28e0bf4b-653c-4021-9e98-bc82fa3a28cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:43.278258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-28e0bf4b-653c-4021-9e98-bc82fa3a28cc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150848 Jul 18 17:10:43.278819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 554/1240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:43 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:43.993645 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7f90c6d4-c83e-4485-8667-4112ff5f718a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:43.994252 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7f90c6d4-c83e-4485-8667-4112ff5f718a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:44.000391 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f90c6d4-c83e-4485-8667-4112ff5f718a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:44.000835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f90c6d4-c83e-4485-8667-4112ff5f718a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:44.001585 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f90c6d4-c83e-4485-8667-4112ff5f718a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:44.002021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7f90c6d4-c83e-4485-8667-4112ff5f718a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:44.065273 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7f90c6d4-c83e-4485-8667-4112ff5f718a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:44.073984 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7f90c6d4-c83e-4485-8667-4112ff5f718a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084200 Jul 18 17:10:44.074533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 687/1241] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:43 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:44.297027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-70dcb191-1e4c-4288-90e4-032d1c2d638f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:44.297597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-70dcb191-1e4c-4288-90e4-032d1c2d638f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:44.305150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70dcb191-1e4c-4288-90e4-032d1c2d638f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:44.305597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70dcb191-1e4c-4288-90e4-032d1c2d638f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:44.306366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70dcb191-1e4c-4288-90e4-032d1c2d638f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:44.306801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-70dcb191-1e4c-4288-90e4-032d1c2d638f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:44.435443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-70dcb191-1e4c-4288-90e4-032d1c2d638f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:44.444052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-70dcb191-1e4c-4288-90e4-032d1c2d638f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152611 Jul 18 17:10:44.444612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 555/1242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:44 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:45.091554 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d156f13f-7b6b-4b9a-9b44-09ca6024b9e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:45.092080 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d156f13f-7b6b-4b9a-9b44-09ca6024b9e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:45.099226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d156f13f-7b6b-4b9a-9b44-09ca6024b9e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:45.099732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d156f13f-7b6b-4b9a-9b44-09ca6024b9e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:45.100487 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d156f13f-7b6b-4b9a-9b44-09ca6024b9e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:45.100923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d156f13f-7b6b-4b9a-9b44-09ca6024b9e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:45.165694 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d156f13f-7b6b-4b9a-9b44-09ca6024b9e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:45.173760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d156f13f-7b6b-4b9a-9b44-09ca6024b9e2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086156 Jul 18 17:10:45.174557 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 688/1243] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:45 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:45.462014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4bb01eee-e9c7-4557-b5c8-5f025cc27c96 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:45.462589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4bb01eee-e9c7-4557-b5c8-5f025cc27c96 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:45.469025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bb01eee-e9c7-4557-b5c8-5f025cc27c96 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:45.469477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bb01eee-e9c7-4557-b5c8-5f025cc27c96 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:45.470245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bb01eee-e9c7-4557-b5c8-5f025cc27c96 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:45.470684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bb01eee-e9c7-4557-b5c8-5f025cc27c96 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:45.602437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4bb01eee-e9c7-4557-b5c8-5f025cc27c96 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:45.610323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4bb01eee-e9c7-4557-b5c8-5f025cc27c96 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152283 Jul 18 17:10:45.610887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 556/1244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:45 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:46.190211 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-55c3e837-ec60-4007-9747-ee77ae665537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:46.191339 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-55c3e837-ec60-4007-9747-ee77ae665537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:46.197605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55c3e837-ec60-4007-9747-ee77ae665537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:46.198043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55c3e837-ec60-4007-9747-ee77ae665537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:46.198815 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55c3e837-ec60-4007-9747-ee77ae665537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:46.199241 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55c3e837-ec60-4007-9747-ee77ae665537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:46.265211 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-55c3e837-ec60-4007-9747-ee77ae665537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:46.274922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-55c3e837-ec60-4007-9747-ee77ae665537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088653 Jul 18 17:10:46.275479 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 689/1245] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:46 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:46.628817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dd8ebf08-3c57-4b03-9894-550599fbb0bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:46.629440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-dd8ebf08-3c57-4b03-9894-550599fbb0bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:46.635997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dd8ebf08-3c57-4b03-9894-550599fbb0bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:46.636443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dd8ebf08-3c57-4b03-9894-550599fbb0bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:46.637212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dd8ebf08-3c57-4b03-9894-550599fbb0bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:46.637648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dd8ebf08-3c57-4b03-9894-550599fbb0bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:46.766241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-dd8ebf08-3c57-4b03-9894-550599fbb0bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:46.774705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dd8ebf08-3c57-4b03-9894-550599fbb0bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150651 Jul 18 17:10:46.775267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 557/1246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:46 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:47.292286 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-82dfe8d2-3da2-481e-badf-0fe07058581c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:47.292891 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-82dfe8d2-3da2-481e-badf-0fe07058581c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:47.298919 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-82dfe8d2-3da2-481e-badf-0fe07058581c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:47.299680 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-82dfe8d2-3da2-481e-badf-0fe07058581c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:47.300440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-82dfe8d2-3da2-481e-badf-0fe07058581c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:47.300881 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-82dfe8d2-3da2-481e-badf-0fe07058581c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:47.361977 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-82dfe8d2-3da2-481e-badf-0fe07058581c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:47.370007 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-82dfe8d2-3da2-481e-badf-0fe07058581c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082048 Jul 18 17:10:47.370618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 690/1247] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:47 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:47.792173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e8bbcca8-7a75-4fc1-84a3-bf428d75eaaa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:47.792781 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e8bbcca8-7a75-4fc1-84a3-bf428d75eaaa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:47.799590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8bbcca8-7a75-4fc1-84a3-bf428d75eaaa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:47.800049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8bbcca8-7a75-4fc1-84a3-bf428d75eaaa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:47.800811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8bbcca8-7a75-4fc1-84a3-bf428d75eaaa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:47.801249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8bbcca8-7a75-4fc1-84a3-bf428d75eaaa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:47.933910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e8bbcca8-7a75-4fc1-84a3-bf428d75eaaa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:47.942566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e8bbcca8-7a75-4fc1-84a3-bf428d75eaaa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154218 Jul 18 17:10:47.943140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 558/1248] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:47 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:48.386194 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-97680a8e-b5b2-4966-a063-edc747143ed6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:48.386738 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-97680a8e-b5b2-4966-a063-edc747143ed6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:48.392787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97680a8e-b5b2-4966-a063-edc747143ed6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:48.393272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97680a8e-b5b2-4966-a063-edc747143ed6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:48.394033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97680a8e-b5b2-4966-a063-edc747143ed6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:48.394472 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97680a8e-b5b2-4966-a063-edc747143ed6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:48.458706 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-97680a8e-b5b2-4966-a063-edc747143ed6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:48.467077 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-97680a8e-b5b2-4966-a063-edc747143ed6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084740 Jul 18 17:10:48.467663 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 691/1249] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:48 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:48.961412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-968d76df-2fa0-4e8a-95c0-94c065d8bc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:48.962040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-968d76df-2fa0-4e8a-95c0-94c065d8bc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:48.968612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-968d76df-2fa0-4e8a-95c0-94c065d8bc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:48.969063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-968d76df-2fa0-4e8a-95c0-94c065d8bc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:48.969837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-968d76df-2fa0-4e8a-95c0-94c065d8bc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:48.970274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-968d76df-2fa0-4e8a-95c0-94c065d8bc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:49.105620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-968d76df-2fa0-4e8a-95c0-94c065d8bc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:49.113954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-968d76df-2fa0-4e8a-95c0-94c065d8bc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156615 Jul 18 17:10:49.114505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 559/1250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:48 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:49.483539 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-64dd869d-8f38-439d-85d8-c320044e6334 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:49.484093 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-64dd869d-8f38-439d-85d8-c320044e6334 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:49.490776 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-64dd869d-8f38-439d-85d8-c320044e6334 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:49.491231 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-64dd869d-8f38-439d-85d8-c320044e6334 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:49.492010 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-64dd869d-8f38-439d-85d8-c320044e6334 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:49.492447 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-64dd869d-8f38-439d-85d8-c320044e6334 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:49.553367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-64dd869d-8f38-439d-85d8-c320044e6334 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:49.561219 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-64dd869d-8f38-439d-85d8-c320044e6334 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081620 Jul 18 17:10:49.561768 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 692/1251] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:49 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:50.131532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b8c6853e-0f44-4813-800e-8c529905d50e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:50.132070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b8c6853e-0f44-4813-800e-8c529905d50e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:50.138539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8c6853e-0f44-4813-800e-8c529905d50e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:50.139005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8c6853e-0f44-4813-800e-8c529905d50e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:50.139773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8c6853e-0f44-4813-800e-8c529905d50e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:50.140198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8c6853e-0f44-4813-800e-8c529905d50e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:50.155325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:50.273882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b8c6853e-0f44-4813-800e-8c529905d50e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:50.281863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b8c6853e-0f44-4813-800e-8c529905d50e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155028 Jul 18 17:10:50.282988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 560/1252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:50 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:50.578710 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-46861d4c-33ac-4e0f-841c-0fe89e4262e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:50.579401 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-46861d4c-33ac-4e0f-841c-0fe89e4262e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:50.585867 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46861d4c-33ac-4e0f-841c-0fe89e4262e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:50.586307 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46861d4c-33ac-4e0f-841c-0fe89e4262e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:50.587089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46861d4c-33ac-4e0f-841c-0fe89e4262e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:50.587540 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-46861d4c-33ac-4e0f-841c-0fe89e4262e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:50.649054 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-46861d4c-33ac-4e0f-841c-0fe89e4262e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:50.657167 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-46861d4c-33ac-4e0f-841c-0fe89e4262e6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082339 Jul 18 17:10:50.657716 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 693/1253] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:50 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:51.299870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7ec58c82-a43b-4d41-aec6-20be586afbd2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:51.300520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7ec58c82-a43b-4d41-aec6-20be586afbd2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:51.307278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ec58c82-a43b-4d41-aec6-20be586afbd2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:51.307759 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ec58c82-a43b-4d41-aec6-20be586afbd2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:51.308532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ec58c82-a43b-4d41-aec6-20be586afbd2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:51.308977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ec58c82-a43b-4d41-aec6-20be586afbd2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:51.442365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7ec58c82-a43b-4d41-aec6-20be586afbd2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:51.450266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7ec58c82-a43b-4d41-aec6-20be586afbd2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154683 Jul 18 17:10:51.450823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 561/1254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:51 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:51.674399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-fad7d544-f171-46b7-9612-cc0ab93bfbdc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:51.675311 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-fad7d544-f171-46b7-9612-cc0ab93bfbdc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:51.681892 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fad7d544-f171-46b7-9612-cc0ab93bfbdc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:51.682341 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fad7d544-f171-46b7-9612-cc0ab93bfbdc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:51.683097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fad7d544-f171-46b7-9612-cc0ab93bfbdc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:51.683569 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fad7d544-f171-46b7-9612-cc0ab93bfbdc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:51.745575 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-fad7d544-f171-46b7-9612-cc0ab93bfbdc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:51.753543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-fad7d544-f171-46b7-9612-cc0ab93bfbdc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083277 Jul 18 17:10:51.754117 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 694/1255] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:51 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:52.467472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ba880750-b783-4fee-b232-ece411942e38 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:52.468057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ba880750-b783-4fee-b232-ece411942e38 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:52.474661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba880750-b783-4fee-b232-ece411942e38 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:52.475109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba880750-b783-4fee-b232-ece411942e38 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:52.475917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba880750-b783-4fee-b232-ece411942e38 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:52.476351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba880750-b783-4fee-b232-ece411942e38 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:52.604827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ba880750-b783-4fee-b232-ece411942e38 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:52.612706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ba880750-b783-4fee-b232-ece411942e38 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.149230 Jul 18 17:10:52.613941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 562/1256] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:52 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:52.770278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3ed9dc66-5efb-4faf-a9cb-63d0ffc71b09 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:52.770886 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3ed9dc66-5efb-4faf-a9cb-63d0ffc71b09 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:52.777174 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3ed9dc66-5efb-4faf-a9cb-63d0ffc71b09 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:52.777621 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3ed9dc66-5efb-4faf-a9cb-63d0ffc71b09 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:52.778391 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3ed9dc66-5efb-4faf-a9cb-63d0ffc71b09 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:52.778823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3ed9dc66-5efb-4faf-a9cb-63d0ffc71b09 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:52.843004 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3ed9dc66-5efb-4faf-a9cb-63d0ffc71b09 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:52.851704 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3ed9dc66-5efb-4faf-a9cb-63d0ffc71b09 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085286 Jul 18 17:10:52.852258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 695/1257] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:52 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:53.630764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c92a4ebc-b0a9-4097-9663-fad6d8bfdf10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:53.631371 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c92a4ebc-b0a9-4097-9663-fad6d8bfdf10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:53.637957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c92a4ebc-b0a9-4097-9663-fad6d8bfdf10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:53.638421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c92a4ebc-b0a9-4097-9663-fad6d8bfdf10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:53.639166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c92a4ebc-b0a9-4097-9663-fad6d8bfdf10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:53.639629 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c92a4ebc-b0a9-4097-9663-fad6d8bfdf10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:53.775291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c92a4ebc-b0a9-4097-9663-fad6d8bfdf10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:53.783395 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c92a4ebc-b0a9-4097-9663-fad6d8bfdf10 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157072 Jul 18 17:10:53.784051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 563/1258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:53 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:53.868870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-bb527a7d-2d8d-4a9b-9593-e8e0ecd917fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:53.869506 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-bb527a7d-2d8d-4a9b-9593-e8e0ecd917fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:53.875627 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb527a7d-2d8d-4a9b-9593-e8e0ecd917fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:53.876080 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb527a7d-2d8d-4a9b-9593-e8e0ecd917fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:53.876880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb527a7d-2d8d-4a9b-9593-e8e0ecd917fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:53.877318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-bb527a7d-2d8d-4a9b-9593-e8e0ecd917fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:53.946040 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-bb527a7d-2d8d-4a9b-9593-e8e0ecd917fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:53.956699 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-bb527a7d-2d8d-4a9b-9593-e8e0ecd917fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.091521 Jul 18 17:10:53.957307 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 696/1259] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:53 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:54.354136 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:10:54.354433 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:10:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:10:54.801585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d9aae48b-98c2-4913-86b3-44b540a6bdfb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:54.802203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d9aae48b-98c2-4913-86b3-44b540a6bdfb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:54.808838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9aae48b-98c2-4913-86b3-44b540a6bdfb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:54.809283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9aae48b-98c2-4913-86b3-44b540a6bdfb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:54.810044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9aae48b-98c2-4913-86b3-44b540a6bdfb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:54.810481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9aae48b-98c2-4913-86b3-44b540a6bdfb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:54.942106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d9aae48b-98c2-4913-86b3-44b540a6bdfb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:54.950312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d9aae48b-98c2-4913-86b3-44b540a6bdfb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152924 Jul 18 17:10:54.950888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 564/1260] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:54 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:54.974128 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-91f4b83a-539b-4d07-8e02-e16933efcc85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:54.974735 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-91f4b83a-539b-4d07-8e02-e16933efcc85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:54.980922 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-91f4b83a-539b-4d07-8e02-e16933efcc85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:54.981367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-91f4b83a-539b-4d07-8e02-e16933efcc85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:54.982154 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-91f4b83a-539b-4d07-8e02-e16933efcc85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:54.982590 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-91f4b83a-539b-4d07-8e02-e16933efcc85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:55.043256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-91f4b83a-539b-4d07-8e02-e16933efcc85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:55.051821 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-91f4b83a-539b-4d07-8e02-e16933efcc85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081571 Jul 18 17:10:55.052313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 697/1261] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:54 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:55.968367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0afcc75b-27ef-4c51-b06e-c8ad56bb6f62 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:55.968960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0afcc75b-27ef-4c51-b06e-c8ad56bb6f62 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:55.976561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0afcc75b-27ef-4c51-b06e-c8ad56bb6f62 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:55.981139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0afcc75b-27ef-4c51-b06e-c8ad56bb6f62 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:55.981139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0afcc75b-27ef-4c51-b06e-c8ad56bb6f62 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:55.981139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0afcc75b-27ef-4c51-b06e-c8ad56bb6f62 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:56.072952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1fba4555-3f02-432d-8ba0-224fe33a07c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:56.072952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1fba4555-3f02-432d-8ba0-224fe33a07c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:56.075952 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fba4555-3f02-432d-8ba0-224fe33a07c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:56.076405 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fba4555-3f02-432d-8ba0-224fe33a07c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:56.077180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fba4555-3f02-432d-8ba0-224fe33a07c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:56.077618 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1fba4555-3f02-432d-8ba0-224fe33a07c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:56.117673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0afcc75b-27ef-4c51-b06e-c8ad56bb6f62 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:56.126039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0afcc75b-27ef-4c51-b06e-c8ad56bb6f62 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.161415 Jul 18 17:10:56.126611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 565/1262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:55 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:56.140441 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1fba4555-3f02-432d-8ba0-224fe33a07c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:56.149275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1fba4555-3f02-432d-8ba0-224fe33a07c9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084668 Jul 18 17:10:56.149897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 698/1263] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:56 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:57.143725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-101097db-34f0-4a7f-869a-60a5409d17da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:57.144275 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-101097db-34f0-4a7f-869a-60a5409d17da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:57.150957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-101097db-34f0-4a7f-869a-60a5409d17da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:57.151402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-101097db-34f0-4a7f-869a-60a5409d17da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:57.152461 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-101097db-34f0-4a7f-869a-60a5409d17da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:57.152903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-101097db-34f0-4a7f-869a-60a5409d17da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:57.166851 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-571dde9e-0134-4aab-a7b7-4e742d498e93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:57.167596 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-571dde9e-0134-4aab-a7b7-4e742d498e93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:57.173826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-571dde9e-0134-4aab-a7b7-4e742d498e93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:57.174614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-571dde9e-0134-4aab-a7b7-4e742d498e93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:57.175388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-571dde9e-0134-4aab-a7b7-4e742d498e93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:57.175848 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-571dde9e-0134-4aab-a7b7-4e742d498e93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:57.242811 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-571dde9e-0134-4aab-a7b7-4e742d498e93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:57.258723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-571dde9e-0134-4aab-a7b7-4e742d498e93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.095603 Jul 18 17:10:57.259332 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 699/1264] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:57 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:57.287218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-101097db-34f0-4a7f-869a-60a5409d17da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:57.295342 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-101097db-34f0-4a7f-869a-60a5409d17da tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155610 Jul 18 17:10:57.295982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 566/1265] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:57 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:58.275433 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-febfce05-ef20-4735-8082-d8adc4b03240 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:58.276088 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-febfce05-ef20-4735-8082-d8adc4b03240 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:58.282160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-febfce05-ef20-4735-8082-d8adc4b03240 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:58.282599 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-febfce05-ef20-4735-8082-d8adc4b03240 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:58.283344 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-febfce05-ef20-4735-8082-d8adc4b03240 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:58.283799 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-febfce05-ef20-4735-8082-d8adc4b03240 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:58.313655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3b983eac-494c-41a9-98be-279770c89b9b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:58.314286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3b983eac-494c-41a9-98be-279770c89b9b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:58.321599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b983eac-494c-41a9-98be-279770c89b9b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:58.322043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b983eac-494c-41a9-98be-279770c89b9b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:58.322809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b983eac-494c-41a9-98be-279770c89b9b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:58.323347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b983eac-494c-41a9-98be-279770c89b9b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:58.347001 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-febfce05-ef20-4735-8082-d8adc4b03240 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:58.355473 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-febfce05-ef20-4735-8082-d8adc4b03240 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084148 Jul 18 17:10:58.356243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 700/1266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:58 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:58.452993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3b983eac-494c-41a9-98be-279770c89b9b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:58.461261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3b983eac-494c-41a9-98be-279770c89b9b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151533 Jul 18 17:10:58.461817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 567/1267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:58 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:10:59.372801 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ab62aec7-e44f-49eb-b864-5f0a3a5d5372 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:59.373443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ab62aec7-e44f-49eb-b864-5f0a3a5d5372 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:59.379372 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab62aec7-e44f-49eb-b864-5f0a3a5d5372 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:59.380494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab62aec7-e44f-49eb-b864-5f0a3a5d5372 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:59.381256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab62aec7-e44f-49eb-b864-5f0a3a5d5372 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:59.381695 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ab62aec7-e44f-49eb-b864-5f0a3a5d5372 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:59.447672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ab62aec7-e44f-49eb-b864-5f0a3a5d5372 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:59.455666 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ab62aec7-e44f-49eb-b864-5f0a3a5d5372 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086743 Jul 18 17:10:59.456215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 701/1268] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:59 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:10:59.478231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b480989f-5cac-4628-adcd-94076085dd30 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:10:59.478827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b480989f-5cac-4628-adcd-94076085dd30 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:10:59.485246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b480989f-5cac-4628-adcd-94076085dd30 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:59.485714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b480989f-5cac-4628-adcd-94076085dd30 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:59.486454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b480989f-5cac-4628-adcd-94076085dd30 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:10:59.486899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b480989f-5cac-4628-adcd-94076085dd30 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:10:59.618657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b480989f-5cac-4628-adcd-94076085dd30 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:10:59.626505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b480989f-5cac-4628-adcd-94076085dd30 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152234 Jul 18 17:10:59.627000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 568/1269] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:10:59 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:00.473255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c469f97b-8057-47d4-ad03-6cd31ee562dc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:00.474056 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c469f97b-8057-47d4-ad03-6cd31ee562dc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:00.480013 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c469f97b-8057-47d4-ad03-6cd31ee562dc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:00.480450 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c469f97b-8057-47d4-ad03-6cd31ee562dc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:00.481193 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c469f97b-8057-47d4-ad03-6cd31ee562dc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:00.481628 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c469f97b-8057-47d4-ad03-6cd31ee562dc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:00.542654 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c469f97b-8057-47d4-ad03-6cd31ee562dc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:00.550789 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c469f97b-8057-47d4-ad03-6cd31ee562dc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081472 Jul 18 17:11:00.551343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 702/1270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:00 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:00.643966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a3d2f4fa-784e-4f02-8485-9ffc7cffb28f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:00.644563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a3d2f4fa-784e-4f02-8485-9ffc7cffb28f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:00.651670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a3d2f4fa-784e-4f02-8485-9ffc7cffb28f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:00.652112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a3d2f4fa-784e-4f02-8485-9ffc7cffb28f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:00.652856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a3d2f4fa-784e-4f02-8485-9ffc7cffb28f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:00.653287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a3d2f4fa-784e-4f02-8485-9ffc7cffb28f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:00.781940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a3d2f4fa-784e-4f02-8485-9ffc7cffb28f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:00.790667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a3d2f4fa-784e-4f02-8485-9ffc7cffb28f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150561 Jul 18 17:11:00.791238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 569/1271] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:00 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:01.569251 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-fa3af528-c31d-4091-b6e7-afc1a7179238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:01.569870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-fa3af528-c31d-4091-b6e7-afc1a7179238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:01.575972 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fa3af528-c31d-4091-b6e7-afc1a7179238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:01.576425 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fa3af528-c31d-4091-b6e7-afc1a7179238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:01.577180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fa3af528-c31d-4091-b6e7-afc1a7179238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:01.577620 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-fa3af528-c31d-4091-b6e7-afc1a7179238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:01.580535 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:01.643380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-fa3af528-c31d-4091-b6e7-afc1a7179238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:01.651915 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-fa3af528-c31d-4091-b6e7-afc1a7179238 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087151 Jul 18 17:11:01.652464 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 703/1272] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:01 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:01.808549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1e4120aa-09b6-4924-afb5-436496bc8359 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:01.809177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1e4120aa-09b6-4924-afb5-436496bc8359 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:01.815777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e4120aa-09b6-4924-afb5-436496bc8359 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:01.816226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e4120aa-09b6-4924-afb5-436496bc8359 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:01.816988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e4120aa-09b6-4924-afb5-436496bc8359 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:01.818178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e4120aa-09b6-4924-afb5-436496bc8359 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:01.955764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1e4120aa-09b6-4924-afb5-436496bc8359 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:01.963847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1e4120aa-09b6-4924-afb5-436496bc8359 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.159239 Jul 18 17:11:01.964993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 570/1273] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:01 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:02.669390 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1b07bdf9-83f2-473b-a831-422d63231a66 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:02.670034 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1b07bdf9-83f2-473b-a831-422d63231a66 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:02.676281 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b07bdf9-83f2-473b-a831-422d63231a66 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:02.676727 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b07bdf9-83f2-473b-a831-422d63231a66 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:02.677476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b07bdf9-83f2-473b-a831-422d63231a66 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:02.677909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b07bdf9-83f2-473b-a831-422d63231a66 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:02.738133 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1b07bdf9-83f2-473b-a831-422d63231a66 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:02.746156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1b07bdf9-83f2-473b-a831-422d63231a66 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.080539 Jul 18 17:11:02.746709 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 704/1274] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:02 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:02.981421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6b948f5f-7b47-4bbc-a638-2a205f3387a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:02.981962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6b948f5f-7b47-4bbc-a638-2a205f3387a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:02.988470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b948f5f-7b47-4bbc-a638-2a205f3387a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:02.988923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b948f5f-7b47-4bbc-a638-2a205f3387a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:02.989683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b948f5f-7b47-4bbc-a638-2a205f3387a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:02.990124 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b948f5f-7b47-4bbc-a638-2a205f3387a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:03.116723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6b948f5f-7b47-4bbc-a638-2a205f3387a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:03.124680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6b948f5f-7b47-4bbc-a638-2a205f3387a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.147558 Jul 18 17:11:03.125238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 571/1275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:02 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:03.762959 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d215e629-9da5-4288-875c-527a2b27b16d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:03.763593 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d215e629-9da5-4288-875c-527a2b27b16d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:03.769849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d215e629-9da5-4288-875c-527a2b27b16d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:03.770434 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d215e629-9da5-4288-875c-527a2b27b16d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:03.771202 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d215e629-9da5-4288-875c-527a2b27b16d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:03.771683 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d215e629-9da5-4288-875c-527a2b27b16d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:03.833484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d215e629-9da5-4288-875c-527a2b27b16d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:03.841726 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d215e629-9da5-4288-875c-527a2b27b16d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082623 Jul 18 17:11:03.842284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 705/1276] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:03 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:04.143293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6944cf3a-ca5a-485a-9adb-8f5f705b4846 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:04.143935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6944cf3a-ca5a-485a-9adb-8f5f705b4846 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:04.146049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=52 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:04.151865 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6944cf3a-ca5a-485a-9adb-8f5f705b4846 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:04.152308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6944cf3a-ca5a-485a-9adb-8f5f705b4846 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:04.153062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6944cf3a-ca5a-485a-9adb-8f5f705b4846 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:04.153496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6944cf3a-ca5a-485a-9adb-8f5f705b4846 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:04.293568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6944cf3a-ca5a-485a-9adb-8f5f705b4846 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:04.301710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6944cf3a-ca5a-485a-9adb-8f5f705b4846 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.162990 Jul 18 17:11:04.302281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 572/1277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:04 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:04.858209 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ea96a72c-18a1-4dfc-8d3d-7e4cfe67cbb2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:04.858809 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ea96a72c-18a1-4dfc-8d3d-7e4cfe67cbb2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:04.860711 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=54 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:04.865504 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea96a72c-18a1-4dfc-8d3d-7e4cfe67cbb2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:04.866615 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea96a72c-18a1-4dfc-8d3d-7e4cfe67cbb2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:04.867359 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea96a72c-18a1-4dfc-8d3d-7e4cfe67cbb2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:04.867897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea96a72c-18a1-4dfc-8d3d-7e4cfe67cbb2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:04.930412 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ea96a72c-18a1-4dfc-8d3d-7e4cfe67cbb2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:04.938545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ea96a72c-18a1-4dfc-8d3d-7e4cfe67cbb2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084189 Jul 18 17:11:04.939113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 706/1278] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:04 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:05.318109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2015cadd-64c7-45b5-9adb-43c97d670d81 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:05.318692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2015cadd-64c7-45b5-9adb-43c97d670d81 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:05.325384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2015cadd-64c7-45b5-9adb-43c97d670d81 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:05.325822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2015cadd-64c7-45b5-9adb-43c97d670d81 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:05.326564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2015cadd-64c7-45b5-9adb-43c97d670d81 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:05.326990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2015cadd-64c7-45b5-9adb-43c97d670d81 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:05.455151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2015cadd-64c7-45b5-9adb-43c97d670d81 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:05.463960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2015cadd-64c7-45b5-9adb-43c97d670d81 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.149597 Jul 18 17:11:05.464529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 573/1279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:05 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:05.957210 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-86f12dbf-a1bb-4345-a576-359c490bfd4d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:05.957810 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-86f12dbf-a1bb-4345-a576-359c490bfd4d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:05.964544 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-86f12dbf-a1bb-4345-a576-359c490bfd4d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:05.964985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-86f12dbf-a1bb-4345-a576-359c490bfd4d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:05.965725 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-86f12dbf-a1bb-4345-a576-359c490bfd4d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:05.966150 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-86f12dbf-a1bb-4345-a576-359c490bfd4d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:06.031460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-86f12dbf-a1bb-4345-a576-359c490bfd4d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:06.039390 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-86f12dbf-a1bb-4345-a576-359c490bfd4d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086088 Jul 18 17:11:06.039982 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 707/1280] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:05 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:06.480965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0c83841f-7282-4e36-9485-538b7b745a60 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:06.481567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0c83841f-7282-4e36-9485-538b7b745a60 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:06.488083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c83841f-7282-4e36-9485-538b7b745a60 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:06.488532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c83841f-7282-4e36-9485-538b7b745a60 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:06.489287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c83841f-7282-4e36-9485-538b7b745a60 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:06.489725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c83841f-7282-4e36-9485-538b7b745a60 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:06.620237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0c83841f-7282-4e36-9485-538b7b745a60 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:06.628161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0c83841f-7282-4e36-9485-538b7b745a60 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151063 Jul 18 17:11:06.628733 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 574/1281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:06 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:07.056721 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f64a4493-84d0-4c30-9d3a-6ceb2160f940 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:07.057306 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f64a4493-84d0-4c30-9d3a-6ceb2160f940 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:07.063484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f64a4493-84d0-4c30-9d3a-6ceb2160f940 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:07.063951 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f64a4493-84d0-4c30-9d3a-6ceb2160f940 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:07.064700 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f64a4493-84d0-4c30-9d3a-6ceb2160f940 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:07.065126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f64a4493-84d0-4c30-9d3a-6ceb2160f940 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:07.126820 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f64a4493-84d0-4c30-9d3a-6ceb2160f940 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:07.135108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f64a4493-84d0-4c30-9d3a-6ceb2160f940 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082465 Jul 18 17:11:07.135706 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 708/1282] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:07 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:07.646137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7f99e7dd-8647-4f85-a5d3-bac1eccd1ea5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:07.646789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7f99e7dd-8647-4f85-a5d3-bac1eccd1ea5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:07.653955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f99e7dd-8647-4f85-a5d3-bac1eccd1ea5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:07.654406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f99e7dd-8647-4f85-a5d3-bac1eccd1ea5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:07.655163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f99e7dd-8647-4f85-a5d3-bac1eccd1ea5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:07.655643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f99e7dd-8647-4f85-a5d3-bac1eccd1ea5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:07.786456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7f99e7dd-8647-4f85-a5d3-bac1eccd1ea5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:07.794434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7f99e7dd-8647-4f85-a5d3-bac1eccd1ea5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152175 Jul 18 17:11:07.794991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 575/1283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:07 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:08.151623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1d1a369e-fba2-4e47-87fa-e6ddd334f28d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:08.152226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1d1a369e-fba2-4e47-87fa-e6ddd334f28d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:08.158235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1d1a369e-fba2-4e47-87fa-e6ddd334f28d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:08.158672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1d1a369e-fba2-4e47-87fa-e6ddd334f28d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:08.159414 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1d1a369e-fba2-4e47-87fa-e6ddd334f28d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:08.159868 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1d1a369e-fba2-4e47-87fa-e6ddd334f28d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:08.225580 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1d1a369e-fba2-4e47-87fa-e6ddd334f28d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:08.233748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1d1a369e-fba2-4e47-87fa-e6ddd334f28d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085953 Jul 18 17:11:08.234298 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 709/1284] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:08 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:08.812701 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a8d2f7bd-fa59-4b30-8f19-47cfa528ea32 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:08.813289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a8d2f7bd-fa59-4b30-8f19-47cfa528ea32 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:08.819769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8d2f7bd-fa59-4b30-8f19-47cfa528ea32 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:08.820208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8d2f7bd-fa59-4b30-8f19-47cfa528ea32 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:08.821610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8d2f7bd-fa59-4b30-8f19-47cfa528ea32 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:08.822026 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8d2f7bd-fa59-4b30-8f19-47cfa528ea32 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:08.954559 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a8d2f7bd-fa59-4b30-8f19-47cfa528ea32 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:08.963638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a8d2f7bd-fa59-4b30-8f19-47cfa528ea32 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154850 Jul 18 17:11:08.964204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 576/1285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:08 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:09.251646 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ea9412d7-36c2-45c0-88e7-1b7531ffed63 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:09.252244 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ea9412d7-36c2-45c0-88e7-1b7531ffed63 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:09.259000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea9412d7-36c2-45c0-88e7-1b7531ffed63 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:09.259463 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea9412d7-36c2-45c0-88e7-1b7531ffed63 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:09.260278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea9412d7-36c2-45c0-88e7-1b7531ffed63 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:09.260717 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ea9412d7-36c2-45c0-88e7-1b7531ffed63 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:09.321964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ea9412d7-36c2-45c0-88e7-1b7531ffed63 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:09.329901 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ea9412d7-36c2-45c0-88e7-1b7531ffed63 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082277 Jul 18 17:11:09.330438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 710/1286] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:09 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:09.981721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-863bae7d-3603-45ad-9525-7db3db30cc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:09.982374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-863bae7d-3603-45ad-9525-7db3db30cc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:09.988837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-863bae7d-3603-45ad-9525-7db3db30cc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:09.989273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-863bae7d-3603-45ad-9525-7db3db30cc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:09.990029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-863bae7d-3603-45ad-9525-7db3db30cc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:09.990457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-863bae7d-3603-45ad-9525-7db3db30cc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:09.994723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:10.130804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-863bae7d-3603-45ad-9525-7db3db30cc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:10.138990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-863bae7d-3603-45ad-9525-7db3db30cc8f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.161934 Jul 18 17:11:10.139569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 577/1287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:09 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:10.346363 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-60c741f7-1e29-42d7-aadb-16dafb542b13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:10.347042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-60c741f7-1e29-42d7-aadb-16dafb542b13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:10.353642 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60c741f7-1e29-42d7-aadb-16dafb542b13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:10.354092 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60c741f7-1e29-42d7-aadb-16dafb542b13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:10.354850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60c741f7-1e29-42d7-aadb-16dafb542b13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:10.355363 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60c741f7-1e29-42d7-aadb-16dafb542b13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:10.422119 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-60c741f7-1e29-42d7-aadb-16dafb542b13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:10.430503 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-60c741f7-1e29-42d7-aadb-16dafb542b13 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088135 Jul 18 17:11:10.431064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 711/1288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:10 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:11.156274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-48e2ae14-54ec-4a0a-9b42-9bf845cd28e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:11.156821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-48e2ae14-54ec-4a0a-9b42-9bf845cd28e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:11.163308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48e2ae14-54ec-4a0a-9b42-9bf845cd28e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:11.163789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48e2ae14-54ec-4a0a-9b42-9bf845cd28e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:11.164843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48e2ae14-54ec-4a0a-9b42-9bf845cd28e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:11.165294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48e2ae14-54ec-4a0a-9b42-9bf845cd28e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:11.297629 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-48e2ae14-54ec-4a0a-9b42-9bf845cd28e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:11.306113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-48e2ae14-54ec-4a0a-9b42-9bf845cd28e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153775 Jul 18 17:11:11.306676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 578/1289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:11 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:11.448423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4d6eb3ec-26de-4dd0-af0d-db5f5ede1de4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:11.448943 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4d6eb3ec-26de-4dd0-af0d-db5f5ede1de4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:11.454911 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4d6eb3ec-26de-4dd0-af0d-db5f5ede1de4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:11.455351 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4d6eb3ec-26de-4dd0-af0d-db5f5ede1de4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:11.456137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4d6eb3ec-26de-4dd0-af0d-db5f5ede1de4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:11.456570 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4d6eb3ec-26de-4dd0-af0d-db5f5ede1de4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:11.518516 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4d6eb3ec-26de-4dd0-af0d-db5f5ede1de4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:11.526679 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4d6eb3ec-26de-4dd0-af0d-db5f5ede1de4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083019 Jul 18 17:11:11.527235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 712/1290] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:11 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:12.323626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4fafbd43-bc64-446d-b2e9-9c304bb9c54a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:12.324236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4fafbd43-bc64-446d-b2e9-9c304bb9c54a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:12.331714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4fafbd43-bc64-446d-b2e9-9c304bb9c54a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:12.332161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4fafbd43-bc64-446d-b2e9-9c304bb9c54a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:12.332929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4fafbd43-bc64-446d-b2e9-9c304bb9c54a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:12.333376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4fafbd43-bc64-446d-b2e9-9c304bb9c54a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:12.467657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4fafbd43-bc64-446d-b2e9-9c304bb9c54a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:12.475553 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4fafbd43-bc64-446d-b2e9-9c304bb9c54a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156317 Jul 18 17:11:12.476108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 579/1291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:12 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:12.544092 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3d35e33d-b08e-46e7-baa5-8990f6e19480 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:12.544693 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3d35e33d-b08e-46e7-baa5-8990f6e19480 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:12.550856 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d35e33d-b08e-46e7-baa5-8990f6e19480 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:12.551293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d35e33d-b08e-46e7-baa5-8990f6e19480 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:12.552066 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d35e33d-b08e-46e7-baa5-8990f6e19480 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:12.552492 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d35e33d-b08e-46e7-baa5-8990f6e19480 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:12.616292 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3d35e33d-b08e-46e7-baa5-8990f6e19480 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:12.624793 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3d35e33d-b08e-46e7-baa5-8990f6e19480 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085082 Jul 18 17:11:12.625358 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 713/1292] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:12 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:13.494463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ed8422c3-a43f-48ec-81e1-26eed9bda68e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:13.495058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ed8422c3-a43f-48ec-81e1-26eed9bda68e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:13.501576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed8422c3-a43f-48ec-81e1-26eed9bda68e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:13.502013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed8422c3-a43f-48ec-81e1-26eed9bda68e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:13.502763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed8422c3-a43f-48ec-81e1-26eed9bda68e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:13.503190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed8422c3-a43f-48ec-81e1-26eed9bda68e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:13.639662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ed8422c3-a43f-48ec-81e1-26eed9bda68e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:13.642184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d39043a8-00c3-4a87-a034-f81202b2d082 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:13.642794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d39043a8-00c3-4a87-a034-f81202b2d082 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:13.647809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ed8422c3-a43f-48ec-81e1-26eed9bda68e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.158293 Jul 18 17:11:13.648382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 580/1293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:13 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:13.648759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d39043a8-00c3-4a87-a034-f81202b2d082 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:13.649227 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d39043a8-00c3-4a87-a034-f81202b2d082 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:13.649956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d39043a8-00c3-4a87-a034-f81202b2d082 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:13.650386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d39043a8-00c3-4a87-a034-f81202b2d082 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:13.712578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d39043a8-00c3-4a87-a034-f81202b2d082 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:13.720490 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d39043a8-00c3-4a87-a034-f81202b2d082 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082020 Jul 18 17:11:13.721033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 714/1294] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:13 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:14.665552 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-851b32d0-9e02-4e32-bf0e-64634e393c85 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:14.666217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-851b32d0-9e02-4e32-bf0e-64634e393c85 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:14.672779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-851b32d0-9e02-4e32-bf0e-64634e393c85 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:14.673226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-851b32d0-9e02-4e32-bf0e-64634e393c85 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:14.674238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-851b32d0-9e02-4e32-bf0e-64634e393c85 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:14.674677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-851b32d0-9e02-4e32-bf0e-64634e393c85 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:14.737882 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ba86529b-0fab-478a-81a6-75a9b7013539 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:14.738747 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ba86529b-0fab-478a-81a6-75a9b7013539 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:14.746590 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba86529b-0fab-478a-81a6-75a9b7013539 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:14.747483 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba86529b-0fab-478a-81a6-75a9b7013539 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:14.748466 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba86529b-0fab-478a-81a6-75a9b7013539 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:14.750006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ba86529b-0fab-478a-81a6-75a9b7013539 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:14.809447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-851b32d0-9e02-4e32-bf0e-64634e393c85 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:14.815058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ba86529b-0fab-478a-81a6-75a9b7013539 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:14.817771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-851b32d0-9e02-4e32-bf0e-64634e393c85 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156613 Jul 18 17:11:14.818350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 581/1295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:14 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:14.824064 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ba86529b-0fab-478a-81a6-75a9b7013539 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.089871 Jul 18 17:11:14.824486 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 715/1296] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:14 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:15.835755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-45e2a8e1-e2fb-4ad4-8f21-eb05f6e8689e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:15.836428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-45e2a8e1-e2fb-4ad4-8f21-eb05f6e8689e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:15.841512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d0096fb7-7b56-4ada-a520-665bfd307387 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:15.842123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d0096fb7-7b56-4ada-a520-665bfd307387 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:15.843316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45e2a8e1-e2fb-4ad4-8f21-eb05f6e8689e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:15.843803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45e2a8e1-e2fb-4ad4-8f21-eb05f6e8689e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:15.844568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45e2a8e1-e2fb-4ad4-8f21-eb05f6e8689e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:15.845005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45e2a8e1-e2fb-4ad4-8f21-eb05f6e8689e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:15.848207 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d0096fb7-7b56-4ada-a520-665bfd307387 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:15.848655 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d0096fb7-7b56-4ada-a520-665bfd307387 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:15.849461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d0096fb7-7b56-4ada-a520-665bfd307387 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:15.849897 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d0096fb7-7b56-4ada-a520-665bfd307387 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:15.912444 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d0096fb7-7b56-4ada-a520-665bfd307387 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:15.921109 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d0096fb7-7b56-4ada-a520-665bfd307387 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083411 Jul 18 17:11:15.921679 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 716/1297] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:15 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:15.982531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-45e2a8e1-e2fb-4ad4-8f21-eb05f6e8689e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:15.990966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-45e2a8e1-e2fb-4ad4-8f21-eb05f6e8689e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.159293 Jul 18 17:11:15.991636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 582/1298] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:15 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:16.938971 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-118e1047-936c-4b61-a8fb-83b56072717d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:16.939603 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-118e1047-936c-4b61-a8fb-83b56072717d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:16.946488 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-118e1047-936c-4b61-a8fb-83b56072717d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:16.946933 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-118e1047-936c-4b61-a8fb-83b56072717d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:16.947754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-118e1047-936c-4b61-a8fb-83b56072717d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:16.948188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-118e1047-936c-4b61-a8fb-83b56072717d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:17.009466 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-118e1047-936c-4b61-a8fb-83b56072717d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:17.009659 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4b3cc4f2-3bd4-4c93-886d-a2a36f4a45ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:17.010217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4b3cc4f2-3bd4-4c93-886d-a2a36f4a45ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:17.016718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b3cc4f2-3bd4-4c93-886d-a2a36f4a45ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:17.017173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b3cc4f2-3bd4-4c93-886d-a2a36f4a45ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:17.017467 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-118e1047-936c-4b61-a8fb-83b56072717d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082368 Jul 18 17:11:17.017946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b3cc4f2-3bd4-4c93-886d-a2a36f4a45ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:17.018058 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 717/1299] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:16 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:17.018383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4b3cc4f2-3bd4-4c93-886d-a2a36f4a45ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:17.149378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4b3cc4f2-3bd4-4c93-886d-a2a36f4a45ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:17.157238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4b3cc4f2-3bd4-4c93-886d-a2a36f4a45ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152178 Jul 18 17:11:17.157802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 583/1300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:17 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:18.034629 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0e002b1c-6936-4263-98b7-9cd769ce71d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:18.035226 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0e002b1c-6936-4263-98b7-9cd769ce71d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:18.041786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e002b1c-6936-4263-98b7-9cd769ce71d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:18.042235 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e002b1c-6936-4263-98b7-9cd769ce71d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:18.042985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e002b1c-6936-4263-98b7-9cd769ce71d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:18.043420 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e002b1c-6936-4263-98b7-9cd769ce71d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:18.105021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0e002b1c-6936-4263-98b7-9cd769ce71d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:18.113059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0e002b1c-6936-4263-98b7-9cd769ce71d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082283 Jul 18 17:11:18.113869 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 718/1301] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:18 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:18.174414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4a66417c-0608-4ac2-9bbf-59ea48beae2c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:18.175091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4a66417c-0608-4ac2-9bbf-59ea48beae2c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:18.182454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a66417c-0608-4ac2-9bbf-59ea48beae2c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:18.183098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a66417c-0608-4ac2-9bbf-59ea48beae2c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:18.184294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a66417c-0608-4ac2-9bbf-59ea48beae2c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:18.184788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a66417c-0608-4ac2-9bbf-59ea48beae2c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:18.319093 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4a66417c-0608-4ac2-9bbf-59ea48beae2c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:18.327425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4a66417c-0608-4ac2-9bbf-59ea48beae2c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157054 Jul 18 17:11:18.328027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 584/1302] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:18 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:19.130158 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-619344fb-d6c9-41cd-9949-1174f0e2a5d1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:19.130704 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-619344fb-d6c9-41cd-9949-1174f0e2a5d1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:19.137492 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-619344fb-d6c9-41cd-9949-1174f0e2a5d1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:19.137934 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-619344fb-d6c9-41cd-9949-1174f0e2a5d1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:19.138682 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-619344fb-d6c9-41cd-9949-1174f0e2a5d1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:19.139114 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-619344fb-d6c9-41cd-9949-1174f0e2a5d1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:19.210159 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-619344fb-d6c9-41cd-9949-1174f0e2a5d1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:19.212543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:19.219247 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-619344fb-d6c9-41cd-9949-1174f0e2a5d1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.092690 Jul 18 17:11:19.219551 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 719/1303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:19 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:19.345230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a17d01c8-84c9-4751-b666-8165d0f51eaf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:19.345870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a17d01c8-84c9-4751-b666-8165d0f51eaf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:19.353077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a17d01c8-84c9-4751-b666-8165d0f51eaf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:19.353523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a17d01c8-84c9-4751-b666-8165d0f51eaf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:19.354318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a17d01c8-84c9-4751-b666-8165d0f51eaf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:19.354757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a17d01c8-84c9-4751-b666-8165d0f51eaf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:19.486377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a17d01c8-84c9-4751-b666-8165d0f51eaf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:19.495550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a17d01c8-84c9-4751-b666-8165d0f51eaf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154122 Jul 18 17:11:19.496109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 585/1304] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:19 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:20.237246 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8e313c82-2ce0-4575-9f45-ea7e0ae163b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:20.237802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8e313c82-2ce0-4575-9f45-ea7e0ae163b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:20.244476 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e313c82-2ce0-4575-9f45-ea7e0ae163b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:20.244910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e313c82-2ce0-4575-9f45-ea7e0ae163b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:20.245684 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e313c82-2ce0-4575-9f45-ea7e0ae163b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:20.246115 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8e313c82-2ce0-4575-9f45-ea7e0ae163b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:20.307196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8e313c82-2ce0-4575-9f45-ea7e0ae163b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:20.315207 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8e313c82-2ce0-4575-9f45-ea7e0ae163b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082255 Jul 18 17:11:20.315815 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 720/1305] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:20 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:20.512807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0f6d6443-fa72-4548-87d6-169b8a6ca463 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:20.513414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0f6d6443-fa72-4548-87d6-169b8a6ca463 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:20.520407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f6d6443-fa72-4548-87d6-169b8a6ca463 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:20.520854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f6d6443-fa72-4548-87d6-169b8a6ca463 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:20.521612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f6d6443-fa72-4548-87d6-169b8a6ca463 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:20.522049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f6d6443-fa72-4548-87d6-169b8a6ca463 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:20.651220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0f6d6443-fa72-4548-87d6-169b8a6ca463 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:20.659278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0f6d6443-fa72-4548-87d6-169b8a6ca463 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150653 Jul 18 17:11:20.659926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 586/1306] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:20 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:21.332177 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-37a55f9c-217c-4a97-bf88-fde76be3f3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:21.332809 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-37a55f9c-217c-4a97-bf88-fde76be3f3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:21.339017 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-37a55f9c-217c-4a97-bf88-fde76be3f3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:21.339460 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-37a55f9c-217c-4a97-bf88-fde76be3f3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:21.340236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-37a55f9c-217c-4a97-bf88-fde76be3f3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:21.340697 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-37a55f9c-217c-4a97-bf88-fde76be3f3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:21.402054 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-37a55f9c-217c-4a97-bf88-fde76be3f3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:21.410014 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-37a55f9c-217c-4a97-bf88-fde76be3f3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081665 Jul 18 17:11:21.410570 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 721/1307] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:21.676603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cb1e5be5-afef-4ea0-ad17-9044e1d3ebdc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:21.677160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cb1e5be5-afef-4ea0-ad17-9044e1d3ebdc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:21.684636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb1e5be5-afef-4ea0-ad17-9044e1d3ebdc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:21.685085 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb1e5be5-afef-4ea0-ad17-9044e1d3ebdc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:21.685858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb1e5be5-afef-4ea0-ad17-9044e1d3ebdc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:21.686298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb1e5be5-afef-4ea0-ad17-9044e1d3ebdc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:21.818564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb1e5be5-afef-4ea0-ad17-9044e1d3ebdc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:21.826960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cb1e5be5-afef-4ea0-ad17-9044e1d3ebdc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154521 Jul 18 17:11:21.827562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 587/1308] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:21 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:22.426835 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0e59bc76-8edc-457d-9e61-835cf85873f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:22.427373 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0e59bc76-8edc-457d-9e61-835cf85873f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:22.433722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e59bc76-8edc-457d-9e61-835cf85873f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:22.434170 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e59bc76-8edc-457d-9e61-835cf85873f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:22.434924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e59bc76-8edc-457d-9e61-835cf85873f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:22.435362 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0e59bc76-8edc-457d-9e61-835cf85873f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:22.496993 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0e59bc76-8edc-457d-9e61-835cf85873f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:22.504978 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0e59bc76-8edc-457d-9e61-835cf85873f1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082382 Jul 18 17:11:22.505534 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 722/1309] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:22.844067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a31d2777-9a04-4734-a70e-b69fccaa4eb9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:22.844729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a31d2777-9a04-4734-a70e-b69fccaa4eb9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:22.851326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a31d2777-9a04-4734-a70e-b69fccaa4eb9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:22.851820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a31d2777-9a04-4734-a70e-b69fccaa4eb9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:22.852689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a31d2777-9a04-4734-a70e-b69fccaa4eb9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:22.853181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a31d2777-9a04-4734-a70e-b69fccaa4eb9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:22.983005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a31d2777-9a04-4734-a70e-b69fccaa4eb9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:22.990939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a31d2777-9a04-4734-a70e-b69fccaa4eb9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150728 Jul 18 17:11:22.991537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 588/1310] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:22 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:23.522204 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-04bf48e9-1d5f-4cbf-ba0e-430698c93e6b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:23.522887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-04bf48e9-1d5f-4cbf-ba0e-430698c93e6b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:23.529607 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-04bf48e9-1d5f-4cbf-ba0e-430698c93e6b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:23.530053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-04bf48e9-1d5f-4cbf-ba0e-430698c93e6b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:23.530806 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-04bf48e9-1d5f-4cbf-ba0e-430698c93e6b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:23.531249 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-04bf48e9-1d5f-4cbf-ba0e-430698c93e6b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:23.595837 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-04bf48e9-1d5f-4cbf-ba0e-430698c93e6b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:23.604819 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-04bf48e9-1d5f-4cbf-ba0e-430698c93e6b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086421 Jul 18 17:11:23.605380 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 723/1311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:23 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:24.009130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f016819f-dcc9-4ece-be14-44002a67206f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:24.009799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f016819f-dcc9-4ece-be14-44002a67206f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:24.016632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f016819f-dcc9-4ece-be14-44002a67206f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:24.017123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f016819f-dcc9-4ece-be14-44002a67206f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:24.017897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f016819f-dcc9-4ece-be14-44002a67206f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:24.018335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f016819f-dcc9-4ece-be14-44002a67206f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:24.153599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f016819f-dcc9-4ece-be14-44002a67206f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:24.161586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f016819f-dcc9-4ece-be14-44002a67206f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156963 Jul 18 17:11:24.162153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 589/1312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:24 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:24.621667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-55cf0f4d-0993-43c9-8225-241a9c28950f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:24.622354 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-55cf0f4d-0993-43c9-8225-241a9c28950f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:24.628387 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55cf0f4d-0993-43c9-8225-241a9c28950f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:24.628831 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55cf0f4d-0993-43c9-8225-241a9c28950f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:24.629583 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55cf0f4d-0993-43c9-8225-241a9c28950f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:24.630012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-55cf0f4d-0993-43c9-8225-241a9c28950f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:24.692488 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-55cf0f4d-0993-43c9-8225-241a9c28950f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:24.701526 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-55cf0f4d-0993-43c9-8225-241a9c28950f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084264 Jul 18 17:11:24.702096 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 724/1313] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:25.179154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-749ece9d-b343-48da-b631-4f1426fd6103 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:25.179799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-749ece9d-b343-48da-b631-4f1426fd6103 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:25.187422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-749ece9d-b343-48da-b631-4f1426fd6103 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:25.187963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-749ece9d-b343-48da-b631-4f1426fd6103 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:25.188818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-749ece9d-b343-48da-b631-4f1426fd6103 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:25.189249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-749ece9d-b343-48da-b631-4f1426fd6103 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:25.321376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-749ece9d-b343-48da-b631-4f1426fd6103 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:25.329278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-749ece9d-b343-48da-b631-4f1426fd6103 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153968 Jul 18 17:11:25.329846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 590/1314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:25 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:25.718293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7bbcda1f-baf4-4a54-ac7c-9e8dce79e2c7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:25.718902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7bbcda1f-baf4-4a54-ac7c-9e8dce79e2c7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:25.725002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7bbcda1f-baf4-4a54-ac7c-9e8dce79e2c7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:25.725450 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7bbcda1f-baf4-4a54-ac7c-9e8dce79e2c7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:25.726206 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7bbcda1f-baf4-4a54-ac7c-9e8dce79e2c7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:25.726645 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7bbcda1f-baf4-4a54-ac7c-9e8dce79e2c7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:25.788388 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7bbcda1f-baf4-4a54-ac7c-9e8dce79e2c7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:25.796844 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7bbcda1f-baf4-4a54-ac7c-9e8dce79e2c7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082383 Jul 18 17:11:25.797403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 725/1315] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:26.346680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-58b8f083-c00f-4bce-bbc5-dfdd68faa4f1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:26.347246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-58b8f083-c00f-4bce-bbc5-dfdd68faa4f1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:26.354271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58b8f083-c00f-4bce-bbc5-dfdd68faa4f1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:26.354713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58b8f083-c00f-4bce-bbc5-dfdd68faa4f1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:26.355459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58b8f083-c00f-4bce-bbc5-dfdd68faa4f1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:26.355913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58b8f083-c00f-4bce-bbc5-dfdd68faa4f1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:26.485858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-58b8f083-c00f-4bce-bbc5-dfdd68faa4f1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:26.494745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-58b8f083-c00f-4bce-bbc5-dfdd68faa4f1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152001 Jul 18 17:11:26.495311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 591/1316] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:26 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:26.814002 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-aa1e1c05-e472-4069-8cc1-382fa965e06d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:26.814612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-aa1e1c05-e472-4069-8cc1-382fa965e06d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:26.820830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-aa1e1c05-e472-4069-8cc1-382fa965e06d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:26.821289 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-aa1e1c05-e472-4069-8cc1-382fa965e06d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:26.822045 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-aa1e1c05-e472-4069-8cc1-382fa965e06d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:26.822483 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-aa1e1c05-e472-4069-8cc1-382fa965e06d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:26.894511 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-aa1e1c05-e472-4069-8cc1-382fa965e06d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:26.903932 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-aa1e1c05-e472-4069-8cc1-382fa965e06d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.093698 Jul 18 17:11:26.904494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 726/1317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:27.512962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4d8d9536-800d-4219-9c42-6bd24dd43c56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:27.513568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4d8d9536-800d-4219-9c42-6bd24dd43c56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:27.522233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d8d9536-800d-4219-9c42-6bd24dd43c56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:27.522676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d8d9536-800d-4219-9c42-6bd24dd43c56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:27.523443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d8d9536-800d-4219-9c42-6bd24dd43c56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:27.524576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d8d9536-800d-4219-9c42-6bd24dd43c56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:27.659123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4d8d9536-800d-4219-9c42-6bd24dd43c56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:27.667404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4d8d9536-800d-4219-9c42-6bd24dd43c56 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.159379 Jul 18 17:11:27.668007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 592/1318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:27 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:27.921411 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-54ee0ad6-1bf7-4512-a977-b8c8413f7c2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:27.921992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-54ee0ad6-1bf7-4512-a977-b8c8413f7c2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:27.928319 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54ee0ad6-1bf7-4512-a977-b8c8413f7c2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:27.928757 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54ee0ad6-1bf7-4512-a977-b8c8413f7c2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:27.929496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54ee0ad6-1bf7-4512-a977-b8c8413f7c2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:27.930028 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54ee0ad6-1bf7-4512-a977-b8c8413f7c2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:27.994950 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-54ee0ad6-1bf7-4512-a977-b8c8413f7c2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:28.002900 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-54ee0ad6-1bf7-4512-a977-b8c8413f7c2b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085424 Jul 18 17:11:28.003447 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 727/1319] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:28.685910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dc01fec5-7a84-40c0-8e15-50b702ff63be tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:28.686517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-dc01fec5-7a84-40c0-8e15-50b702ff63be tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:28.693136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dc01fec5-7a84-40c0-8e15-50b702ff63be tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:28.693588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dc01fec5-7a84-40c0-8e15-50b702ff63be tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:28.694353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dc01fec5-7a84-40c0-8e15-50b702ff63be tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:28.694794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dc01fec5-7a84-40c0-8e15-50b702ff63be tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:28.825585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-dc01fec5-7a84-40c0-8e15-50b702ff63be tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:28.828611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:28.834878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dc01fec5-7a84-40c0-8e15-50b702ff63be tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152780 Jul 18 17:11:28.835457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 593/1320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:28 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:29.020855 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cc5fec90-7dbc-4e7a-a3ab-a471b52f6e70 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:29.021466 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cc5fec90-7dbc-4e7a-a3ab-a471b52f6e70 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:29.027633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc5fec90-7dbc-4e7a-a3ab-a471b52f6e70 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:29.028083 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc5fec90-7dbc-4e7a-a3ab-a471b52f6e70 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:29.028844 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc5fec90-7dbc-4e7a-a3ab-a471b52f6e70 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:29.029284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cc5fec90-7dbc-4e7a-a3ab-a471b52f6e70 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:29.090603 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cc5fec90-7dbc-4e7a-a3ab-a471b52f6e70 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:29.098483 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cc5fec90-7dbc-4e7a-a3ab-a471b52f6e70 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081492 Jul 18 17:11:29.099054 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 728/1321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:29 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:29.852306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c5243d7c-ca4b-43b9-a6d9-3b56797bf58d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:29.852943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c5243d7c-ca4b-43b9-a6d9-3b56797bf58d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:29.860014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5243d7c-ca4b-43b9-a6d9-3b56797bf58d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:29.860524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5243d7c-ca4b-43b9-a6d9-3b56797bf58d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:29.861470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5243d7c-ca4b-43b9-a6d9-3b56797bf58d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:29.861908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c5243d7c-ca4b-43b9-a6d9-3b56797bf58d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:29.999338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c5243d7c-ca4b-43b9-a6d9-3b56797bf58d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:30.007389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c5243d7c-ca4b-43b9-a6d9-3b56797bf58d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.159155 Jul 18 17:11:30.008685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 594/1322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:29 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:30.116617 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-10353001-9c73-47e2-8b94-964af2df88f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:30.117750 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-10353001-9c73-47e2-8b94-964af2df88f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:30.124044 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-10353001-9c73-47e2-8b94-964af2df88f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:30.124497 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-10353001-9c73-47e2-8b94-964af2df88f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:30.125243 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-10353001-9c73-47e2-8b94-964af2df88f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:30.125677 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-10353001-9c73-47e2-8b94-964af2df88f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:30.187223 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-10353001-9c73-47e2-8b94-964af2df88f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:30.195099 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-10353001-9c73-47e2-8b94-964af2df88f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082315 Jul 18 17:11:30.196313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 729/1323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:31.027024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7a91437e-5921-4bb9-a6d1-3a7a8eeeb835 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:31.027667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7a91437e-5921-4bb9-a6d1-3a7a8eeeb835 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:31.033753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a91437e-5921-4bb9-a6d1-3a7a8eeeb835 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:31.034270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a91437e-5921-4bb9-a6d1-3a7a8eeeb835 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:31.034959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a91437e-5921-4bb9-a6d1-3a7a8eeeb835 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:31.035405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a91437e-5921-4bb9-a6d1-3a7a8eeeb835 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:31.166474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7a91437e-5921-4bb9-a6d1-3a7a8eeeb835 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:31.174705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7a91437e-5921-4bb9-a6d1-3a7a8eeeb835 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152832 Jul 18 17:11:31.175255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 595/1324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:31 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:31.212536 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f33b123c-5cce-43af-9958-2f86ff9cbad1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:31.213242 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f33b123c-5cce-43af-9958-2f86ff9cbad1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:31.219458 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f33b123c-5cce-43af-9958-2f86ff9cbad1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:31.219946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f33b123c-5cce-43af-9958-2f86ff9cbad1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:31.220713 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f33b123c-5cce-43af-9958-2f86ff9cbad1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:31.221175 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f33b123c-5cce-43af-9958-2f86ff9cbad1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:31.282812 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f33b123c-5cce-43af-9958-2f86ff9cbad1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:31.291688 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f33b123c-5cce-43af-9958-2f86ff9cbad1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083073 Jul 18 17:11:31.292252 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 730/1325] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:32.193434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-489491b8-0fd6-4e38-a3e0-fab92e6f95b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:32.194046 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-489491b8-0fd6-4e38-a3e0-fab92e6f95b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:32.201607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-489491b8-0fd6-4e38-a3e0-fab92e6f95b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:32.202054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-489491b8-0fd6-4e38-a3e0-fab92e6f95b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:32.202822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-489491b8-0fd6-4e38-a3e0-fab92e6f95b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:32.203262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-489491b8-0fd6-4e38-a3e0-fab92e6f95b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:32.309438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-40efe7dd-b34b-407c-b603-2dafd16f1bd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:32.310046 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-40efe7dd-b34b-407c-b603-2dafd16f1bd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:32.316491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-40efe7dd-b34b-407c-b603-2dafd16f1bd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:32.316937 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-40efe7dd-b34b-407c-b603-2dafd16f1bd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:32.317696 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-40efe7dd-b34b-407c-b603-2dafd16f1bd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:32.318130 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-40efe7dd-b34b-407c-b603-2dafd16f1bd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:32.336927 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-489491b8-0fd6-4e38-a3e0-fab92e6f95b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:32.344976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-489491b8-0fd6-4e38-a3e0-fab92e6f95b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155313 Jul 18 17:11:32.345470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 596/1326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:32 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:32.385089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-40efe7dd-b34b-407c-b603-2dafd16f1bd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:32.393152 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-40efe7dd-b34b-407c-b603-2dafd16f1bd8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088190 Jul 18 17:11:32.393705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 731/1327] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:33.362259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-598a2b89-8967-447b-b9d2-7de38d70f47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:33.362867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-598a2b89-8967-447b-b9d2-7de38d70f47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:33.370000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-598a2b89-8967-447b-b9d2-7de38d70f47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:33.370444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-598a2b89-8967-447b-b9d2-7de38d70f47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:33.371198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-598a2b89-8967-447b-b9d2-7de38d70f47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:33.371677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-598a2b89-8967-447b-b9d2-7de38d70f47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:33.500884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-598a2b89-8967-447b-b9d2-7de38d70f47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:33.508783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-598a2b89-8967-447b-b9d2-7de38d70f47e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150314 Jul 18 17:11:33.509560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 597/1328] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:33 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:33.527802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-66d3b7ce-2e64-4425-8ca3-1517e930b0ed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:33.528411 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-66d3b7ce-2e64-4425-8ca3-1517e930b0ed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:33.534350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-66d3b7ce-2e64-4425-8ca3-1517e930b0ed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:33.534794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-66d3b7ce-2e64-4425-8ca3-1517e930b0ed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:33.535611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-66d3b7ce-2e64-4425-8ca3-1517e930b0ed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:33.536824 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-66d3b7ce-2e64-4425-8ca3-1517e930b0ed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:33.598613 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-66d3b7ce-2e64-4425-8ca3-1517e930b0ed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:33.607601 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-66d3b7ce-2e64-4425-8ca3-1517e930b0ed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.201255 Jul 18 17:11:33.608164 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 732/1329] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:33 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:34.526113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3b66f004-5004-4896-a0ee-6615bd6ecc3b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:34.526892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3b66f004-5004-4896-a0ee-6615bd6ecc3b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:34.528611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=52 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:34.533354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b66f004-5004-4896-a0ee-6615bd6ecc3b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:34.533803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b66f004-5004-4896-a0ee-6615bd6ecc3b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:34.534566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b66f004-5004-4896-a0ee-6615bd6ecc3b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:34.535010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b66f004-5004-4896-a0ee-6615bd6ecc3b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:34.624498 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e501fbd2-d17b-45be-9e7d-f22b81bb6dd0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:34.625112 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e501fbd2-d17b-45be-9e7d-f22b81bb6dd0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:34.631285 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e501fbd2-d17b-45be-9e7d-f22b81bb6dd0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:34.631776 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e501fbd2-d17b-45be-9e7d-f22b81bb6dd0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:34.632621 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e501fbd2-d17b-45be-9e7d-f22b81bb6dd0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:34.633884 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e501fbd2-d17b-45be-9e7d-f22b81bb6dd0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:34.666529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3b66f004-5004-4896-a0ee-6615bd6ecc3b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:34.675329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3b66f004-5004-4896-a0ee-6615bd6ecc3b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153256 Jul 18 17:11:34.676004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 598/1330] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:34 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:34.703887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e501fbd2-d17b-45be-9e7d-f22b81bb6dd0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:34.714211 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e501fbd2-d17b-45be-9e7d-f22b81bb6dd0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.091200 Jul 18 17:11:34.714211 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 733/1331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:34 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:35.693472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-aa505123-b264-46c5-baed-81559e0c392d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:35.694072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-aa505123-b264-46c5-baed-81559e0c392d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:35.700991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aa505123-b264-46c5-baed-81559e0c392d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:35.701432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aa505123-b264-46c5-baed-81559e0c392d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:35.702189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aa505123-b264-46c5-baed-81559e0c392d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:35.702622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aa505123-b264-46c5-baed-81559e0c392d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:35.729240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d3202d83-b592-4a2f-b128-fc29e9657194 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:35.729847 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d3202d83-b592-4a2f-b128-fc29e9657194 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:35.731722 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=56 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:35.736494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d3202d83-b592-4a2f-b128-fc29e9657194 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:35.736945 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d3202d83-b592-4a2f-b128-fc29e9657194 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:35.737706 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d3202d83-b592-4a2f-b128-fc29e9657194 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:35.738150 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d3202d83-b592-4a2f-b128-fc29e9657194 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:35.803673 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d3202d83-b592-4a2f-b128-fc29e9657194 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:35.812672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d3202d83-b592-4a2f-b128-fc29e9657194 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087784 Jul 18 17:11:35.813225 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 734/1332] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:35.838705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-aa505123-b264-46c5-baed-81559e0c392d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:35.846727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-aa505123-b264-46c5-baed-81559e0c392d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157154 Jul 18 17:11:35.847271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 599/1333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:35 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:36.829936 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e6a5954b-2cd4-492d-aecb-75eae1e4b064 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:36.830549 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e6a5954b-2cd4-492d-aecb-75eae1e4b064 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:36.836768 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6a5954b-2cd4-492d-aecb-75eae1e4b064 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:36.837222 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6a5954b-2cd4-492d-aecb-75eae1e4b064 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:36.838009 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6a5954b-2cd4-492d-aecb-75eae1e4b064 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:36.838447 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e6a5954b-2cd4-492d-aecb-75eae1e4b064 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:36.864298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4de5ddd3-c048-4781-b9f7-1b23aaf2ed58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:36.865014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4de5ddd3-c048-4781-b9f7-1b23aaf2ed58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:36.872355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4de5ddd3-c048-4781-b9f7-1b23aaf2ed58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:36.872841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4de5ddd3-c048-4781-b9f7-1b23aaf2ed58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:36.873610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4de5ddd3-c048-4781-b9f7-1b23aaf2ed58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:36.874045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4de5ddd3-c048-4781-b9f7-1b23aaf2ed58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:36.904534 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e6a5954b-2cd4-492d-aecb-75eae1e4b064 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:36.912920 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e6a5954b-2cd4-492d-aecb-75eae1e4b064 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086743 Jul 18 17:11:36.913490 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 735/1334] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:36 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:37.006483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4de5ddd3-c048-4781-b9f7-1b23aaf2ed58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:37.014867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4de5ddd3-c048-4781-b9f7-1b23aaf2ed58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154382 Jul 18 17:11:37.015435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 600/1335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:36 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:37.929236 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5ea53882-cb38-497b-8ab2-e205667135da tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:37.930142 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5ea53882-cb38-497b-8ab2-e205667135da tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:37.936930 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5ea53882-cb38-497b-8ab2-e205667135da tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:37.937378 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5ea53882-cb38-497b-8ab2-e205667135da tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:37.938145 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5ea53882-cb38-497b-8ab2-e205667135da tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:37.938589 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5ea53882-cb38-497b-8ab2-e205667135da tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:37.954943 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:38.007195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5ea53882-cb38-497b-8ab2-e205667135da tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:38.019939 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5ea53882-cb38-497b-8ab2-e205667135da tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.094198 Jul 18 17:11:38.020411 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 736/1336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:37 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:38.033566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0bd87efc-3c89-4942-bf71-70945901d2b8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:38.034495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0bd87efc-3c89-4942-bf71-70945901d2b8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:38.044078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0bd87efc-3c89-4942-bf71-70945901d2b8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:38.044641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0bd87efc-3c89-4942-bf71-70945901d2b8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:38.045756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0bd87efc-3c89-4942-bf71-70945901d2b8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:38.046503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0bd87efc-3c89-4942-bf71-70945901d2b8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:38.191948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0bd87efc-3c89-4942-bf71-70945901d2b8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:38.200745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0bd87efc-3c89-4942-bf71-70945901d2b8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.172203 Jul 18 17:11:38.201313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 601/1337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:38 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:39.044582 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-db87b278-2033-47e7-a673-e6910fe1a04c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:39.045195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-db87b278-2033-47e7-a673-e6910fe1a04c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:39.051512 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-db87b278-2033-47e7-a673-e6910fe1a04c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:39.051963 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-db87b278-2033-47e7-a673-e6910fe1a04c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:39.052760 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-db87b278-2033-47e7-a673-e6910fe1a04c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:39.053192 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-db87b278-2033-47e7-a673-e6910fe1a04c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:39.114026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-db87b278-2033-47e7-a673-e6910fe1a04c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:39.122106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-db87b278-2033-47e7-a673-e6910fe1a04c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081440 Jul 18 17:11:39.122650 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 737/1338] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:39 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:39.218379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c505e0ab-2b43-4dcb-8ba4-d1a80183c2e2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:39.219013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c505e0ab-2b43-4dcb-8ba4-d1a80183c2e2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:39.226871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c505e0ab-2b43-4dcb-8ba4-d1a80183c2e2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:39.227322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c505e0ab-2b43-4dcb-8ba4-d1a80183c2e2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:39.228131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c505e0ab-2b43-4dcb-8ba4-d1a80183c2e2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:39.228571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c505e0ab-2b43-4dcb-8ba4-d1a80183c2e2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:39.361543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c505e0ab-2b43-4dcb-8ba4-d1a80183c2e2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:39.370507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c505e0ab-2b43-4dcb-8ba4-d1a80183c2e2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156428 Jul 18 17:11:39.371076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 602/1339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:39 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:40.139065 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-8642828c-5b8d-4fa1-b247-fc52901e47fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:40.139853 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-8642828c-5b8d-4fa1-b247-fc52901e47fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:40.146123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8642828c-5b8d-4fa1-b247-fc52901e47fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:40.146433 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8642828c-5b8d-4fa1-b247-fc52901e47fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:40.147191 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8642828c-5b8d-4fa1-b247-fc52901e47fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:40.147667 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-8642828c-5b8d-4fa1-b247-fc52901e47fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:40.209597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-8642828c-5b8d-4fa1-b247-fc52901e47fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:40.218550 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-8642828c-5b8d-4fa1-b247-fc52901e47fe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083357 Jul 18 17:11:40.219230 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 738/1340] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:40 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:40.388400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a325524b-dad9-4030-8d12-e3b9d2caf1aa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:40.388942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a325524b-dad9-4030-8d12-e3b9d2caf1aa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:40.395356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a325524b-dad9-4030-8d12-e3b9d2caf1aa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:40.395806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a325524b-dad9-4030-8d12-e3b9d2caf1aa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:40.396590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a325524b-dad9-4030-8d12-e3b9d2caf1aa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:40.397008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a325524b-dad9-4030-8d12-e3b9d2caf1aa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:40.525571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a325524b-dad9-4030-8d12-e3b9d2caf1aa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:40.533524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a325524b-dad9-4030-8d12-e3b9d2caf1aa tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.149200 Jul 18 17:11:40.534080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 603/1341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:40 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:41.235941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-b944575b-fed8-4552-b7cd-c494e1699b73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:41.236490 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-b944575b-fed8-4552-b7cd-c494e1699b73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:41.243216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b944575b-fed8-4552-b7cd-c494e1699b73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:41.243695 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b944575b-fed8-4552-b7cd-c494e1699b73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:41.244456 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b944575b-fed8-4552-b7cd-c494e1699b73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:41.244889 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-b944575b-fed8-4552-b7cd-c494e1699b73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:41.309106 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-b944575b-fed8-4552-b7cd-c494e1699b73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:41.316956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-b944575b-fed8-4552-b7cd-c494e1699b73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084954 Jul 18 17:11:41.317502 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 739/1342] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:41 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:41.550902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4bb285ac-6b8b-42de-a8c9-9c14a5f10a02 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:41.551522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4bb285ac-6b8b-42de-a8c9-9c14a5f10a02 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:41.559036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bb285ac-6b8b-42de-a8c9-9c14a5f10a02 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:41.559474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bb285ac-6b8b-42de-a8c9-9c14a5f10a02 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:41.560248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bb285ac-6b8b-42de-a8c9-9c14a5f10a02 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:41.560673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bb285ac-6b8b-42de-a8c9-9c14a5f10a02 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:41.695590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4bb285ac-6b8b-42de-a8c9-9c14a5f10a02 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:41.703544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4bb285ac-6b8b-42de-a8c9-9c14a5f10a02 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156769 Jul 18 17:11:41.704117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 604/1343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:41 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:42.335144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-975d6f90-9baa-4612-b5ea-02d1dd3f2570 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:42.336343 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-975d6f90-9baa-4612-b5ea-02d1dd3f2570 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:42.342538 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-975d6f90-9baa-4612-b5ea-02d1dd3f2570 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:42.342924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-975d6f90-9baa-4612-b5ea-02d1dd3f2570 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:42.343717 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-975d6f90-9baa-4612-b5ea-02d1dd3f2570 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:42.344163 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-975d6f90-9baa-4612-b5ea-02d1dd3f2570 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:42.405743 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-975d6f90-9baa-4612-b5ea-02d1dd3f2570 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:42.414267 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-975d6f90-9baa-4612-b5ea-02d1dd3f2570 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082940 Jul 18 17:11:42.414860 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 740/1344] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:42 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:42.720804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5d9203ca-91b5-4a41-8a94-44d066432098 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:42.721351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5d9203ca-91b5-4a41-8a94-44d066432098 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:42.727999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d9203ca-91b5-4a41-8a94-44d066432098 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:42.728438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d9203ca-91b5-4a41-8a94-44d066432098 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:42.729186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d9203ca-91b5-4a41-8a94-44d066432098 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:42.729624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d9203ca-91b5-4a41-8a94-44d066432098 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:42.861174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5d9203ca-91b5-4a41-8a94-44d066432098 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:42.869886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5d9203ca-91b5-4a41-8a94-44d066432098 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152976 Jul 18 17:11:42.870448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 605/1345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:42 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:43.431108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-370ab6fd-1f69-4dce-a17d-b97814ab460a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:43.431751 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-370ab6fd-1f69-4dce-a17d-b97814ab460a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:43.437735 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-370ab6fd-1f69-4dce-a17d-b97814ab460a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:43.438178 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-370ab6fd-1f69-4dce-a17d-b97814ab460a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:43.438929 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-370ab6fd-1f69-4dce-a17d-b97814ab460a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:43.439361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-370ab6fd-1f69-4dce-a17d-b97814ab460a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:43.499649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-370ab6fd-1f69-4dce-a17d-b97814ab460a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:43.507567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-370ab6fd-1f69-4dce-a17d-b97814ab460a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.080346 Jul 18 17:11:43.508136 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 741/1346] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:43 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:43.887833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-da655bf6-62e8-490e-92fe-805b11aa23f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:43.888435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-da655bf6-62e8-490e-92fe-805b11aa23f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:43.894819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da655bf6-62e8-490e-92fe-805b11aa23f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:43.895262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da655bf6-62e8-490e-92fe-805b11aa23f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:43.896043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da655bf6-62e8-490e-92fe-805b11aa23f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:43.896477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da655bf6-62e8-490e-92fe-805b11aa23f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:44.263294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-da655bf6-62e8-490e-92fe-805b11aa23f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:44.271236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-da655bf6-62e8-490e-92fe-805b11aa23f6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.387310 Jul 18 17:11:44.271833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 606/1347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:43 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:44.524475 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a1b34f6f-5726-4c4f-9534-21927d5276c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:44.525113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a1b34f6f-5726-4c4f-9534-21927d5276c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:44.531137 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a1b34f6f-5726-4c4f-9534-21927d5276c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:44.531612 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a1b34f6f-5726-4c4f-9534-21927d5276c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:44.532400 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a1b34f6f-5726-4c4f-9534-21927d5276c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:44.533108 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a1b34f6f-5726-4c4f-9534-21927d5276c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:44.594278 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a1b34f6f-5726-4c4f-9534-21927d5276c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:44.603836 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a1b34f6f-5726-4c4f-9534-21927d5276c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083293 Jul 18 17:11:44.604395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 742/1348] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:44 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:45.288482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-320ea826-7130-42a9-9eb2-6848ee952ecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:45.289149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-320ea826-7130-42a9-9eb2-6848ee952ecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:45.295844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-320ea826-7130-42a9-9eb2-6848ee952ecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:45.296296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-320ea826-7130-42a9-9eb2-6848ee952ecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:45.297068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-320ea826-7130-42a9-9eb2-6848ee952ecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:45.297506 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-320ea826-7130-42a9-9eb2-6848ee952ecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:45.426816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-320ea826-7130-42a9-9eb2-6848ee952ecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:45.435365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-320ea826-7130-42a9-9eb2-6848ee952ecb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150746 Jul 18 17:11:45.436069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 607/1349] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:45 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:45.621701 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-49f90653-2a3e-4d93-8d14-587ad9365006 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:45.622251 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-49f90653-2a3e-4d93-8d14-587ad9365006 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:45.628346 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-49f90653-2a3e-4d93-8d14-587ad9365006 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:45.628791 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-49f90653-2a3e-4d93-8d14-587ad9365006 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:45.629543 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-49f90653-2a3e-4d93-8d14-587ad9365006 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:45.629974 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-49f90653-2a3e-4d93-8d14-587ad9365006 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:45.694595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-49f90653-2a3e-4d93-8d14-587ad9365006 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:45.702672 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-49f90653-2a3e-4d93-8d14-587ad9365006 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085543 Jul 18 17:11:45.703221 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 743/1350] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:45 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:46.453302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1a6a11e3-c383-4616-b36a-b82e60ae99ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:46.453847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1a6a11e3-c383-4616-b36a-b82e60ae99ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:46.460429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a6a11e3-c383-4616-b36a-b82e60ae99ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:46.460876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a6a11e3-c383-4616-b36a-b82e60ae99ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:46.461627 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a6a11e3-c383-4616-b36a-b82e60ae99ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:46.462063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a6a11e3-c383-4616-b36a-b82e60ae99ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:46.592869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1a6a11e3-c383-4616-b36a-b82e60ae99ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:46.600817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1a6a11e3-c383-4616-b36a-b82e60ae99ed tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151511 Jul 18 17:11:46.601389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 608/1351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:46 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:46.719272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e7ca37e7-556c-4f98-92a1-da844911f4ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:46.719813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e7ca37e7-556c-4f98-92a1-da844911f4ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:46.725850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7ca37e7-556c-4f98-92a1-da844911f4ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:46.726296 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7ca37e7-556c-4f98-92a1-da844911f4ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:46.727043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7ca37e7-556c-4f98-92a1-da844911f4ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:46.727480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e7ca37e7-556c-4f98-92a1-da844911f4ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:46.789182 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e7ca37e7-556c-4f98-92a1-da844911f4ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:46.797284 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e7ca37e7-556c-4f98-92a1-da844911f4ea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082004 Jul 18 17:11:46.797849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 744/1352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:46 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:47.618391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9474cd84-b86d-485b-949b-9bdccbb1441a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:47.619031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9474cd84-b86d-485b-949b-9bdccbb1441a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:47.625665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9474cd84-b86d-485b-949b-9bdccbb1441a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:47.626112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9474cd84-b86d-485b-949b-9bdccbb1441a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:47.626899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9474cd84-b86d-485b-949b-9bdccbb1441a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:47.627336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9474cd84-b86d-485b-949b-9bdccbb1441a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:47.753957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9474cd84-b86d-485b-949b-9bdccbb1441a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:47.763120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9474cd84-b86d-485b-949b-9bdccbb1441a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.148535 Jul 18 17:11:47.763718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 609/1353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:47 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:47.814301 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9bb5f9a2-0c61-4ff7-96e9-5931987d8ca7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:47.814906 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9bb5f9a2-0c61-4ff7-96e9-5931987d8ca7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:47.820970 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9bb5f9a2-0c61-4ff7-96e9-5931987d8ca7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:47.821414 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9bb5f9a2-0c61-4ff7-96e9-5931987d8ca7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:47.822164 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9bb5f9a2-0c61-4ff7-96e9-5931987d8ca7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:47.822592 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9bb5f9a2-0c61-4ff7-96e9-5931987d8ca7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:47.884365 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9bb5f9a2-0c61-4ff7-96e9-5931987d8ca7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:47.893123 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9bb5f9a2-0c61-4ff7-96e9-5931987d8ca7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082528 Jul 18 17:11:47.893663 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 745/1354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:47 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:48.780588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-69afe4c4-b077-4d7f-b0f9-31a1f34ec72e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:48.781200 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-69afe4c4-b077-4d7f-b0f9-31a1f34ec72e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:48.787795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69afe4c4-b077-4d7f-b0f9-31a1f34ec72e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:48.788243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69afe4c4-b077-4d7f-b0f9-31a1f34ec72e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:48.789001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69afe4c4-b077-4d7f-b0f9-31a1f34ec72e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:48.789439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69afe4c4-b077-4d7f-b0f9-31a1f34ec72e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:48.805799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:48.910289 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0f9c3541-a74c-435e-a726-140e58b66f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:48.910905 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0f9c3541-a74c-435e-a726-140e58b66f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:48.917104 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f9c3541-a74c-435e-a726-140e58b66f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:48.917544 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f9c3541-a74c-435e-a726-140e58b66f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:48.918313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f9c3541-a74c-435e-a726-140e58b66f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:48.918746 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0f9c3541-a74c-435e-a726-140e58b66f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:48.921097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69afe4c4-b077-4d7f-b0f9-31a1f34ec72e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:48.929320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-69afe4c4-b077-4d7f-b0f9-31a1f34ec72e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153034 Jul 18 17:11:48.929882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 610/1355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:48 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:48.981345 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0f9c3541-a74c-435e-a726-140e58b66f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:48.989340 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0f9c3541-a74c-435e-a726-140e58b66f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082952 Jul 18 17:11:48.989896 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 746/1356] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:48 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:49.946191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cfac833b-066d-466c-9190-3de0f084d4fd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:49.952424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cfac833b-066d-466c-9190-3de0f084d4fd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:49.953376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cfac833b-066d-466c-9190-3de0f084d4fd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:49.953825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cfac833b-066d-466c-9190-3de0f084d4fd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:49.954581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cfac833b-066d-466c-9190-3de0f084d4fd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:49.955017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cfac833b-066d-466c-9190-3de0f084d4fd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:50.006489 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9b57867e-d33d-4b23-81d7-865ec9be89d5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:50.007176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9b57867e-d33d-4b23-81d7-865ec9be89d5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:50.014450 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b57867e-d33d-4b23-81d7-865ec9be89d5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:50.015678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b57867e-d33d-4b23-81d7-865ec9be89d5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:50.015857 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b57867e-d33d-4b23-81d7-865ec9be89d5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:50.016328 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b57867e-d33d-4b23-81d7-865ec9be89d5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:50.083207 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9b57867e-d33d-4b23-81d7-865ec9be89d5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:50.091826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9b57867e-d33d-4b23-81d7-865ec9be89d5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.089259 Jul 18 17:11:50.092326 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 747/1357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:50 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:50.099932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cfac833b-066d-466c-9190-3de0f084d4fd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:50.108239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cfac833b-066d-466c-9190-3de0f084d4fd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.165898 Jul 18 17:11:50.108815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 611/1358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:49 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:51.109393 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-0a9a3172-b50c-4568-b142-a67a45174c27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:51.109946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-0a9a3172-b50c-4568-b142-a67a45174c27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:51.116036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0a9a3172-b50c-4568-b142-a67a45174c27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:51.116471 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0a9a3172-b50c-4568-b142-a67a45174c27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:51.117216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0a9a3172-b50c-4568-b142-a67a45174c27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:51.117643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-0a9a3172-b50c-4568-b142-a67a45174c27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:51.125898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4efa4b44-c18f-4e2a-a331-179abcdbe9c3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:51.126509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4efa4b44-c18f-4e2a-a331-179abcdbe9c3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:51.133130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4efa4b44-c18f-4e2a-a331-179abcdbe9c3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:51.133578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4efa4b44-c18f-4e2a-a331-179abcdbe9c3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:51.134340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4efa4b44-c18f-4e2a-a331-179abcdbe9c3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:51.134779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4efa4b44-c18f-4e2a-a331-179abcdbe9c3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:51.181536 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-0a9a3172-b50c-4568-b142-a67a45174c27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:51.189614 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-0a9a3172-b50c-4568-b142-a67a45174c27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084180 Jul 18 17:11:51.190194 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 748/1359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:51 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:51.268167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4efa4b44-c18f-4e2a-a331-179abcdbe9c3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:51.276104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4efa4b44-c18f-4e2a-a331-179abcdbe9c3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154078 Jul 18 17:11:51.276666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 612/1360] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:51 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:11:52.207545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-45543a86-9444-46bf-bf31-18b258c81b9e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:52.208179 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-45543a86-9444-46bf-bf31-18b258c81b9e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:52.214254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-45543a86-9444-46bf-bf31-18b258c81b9e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:52.214705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-45543a86-9444-46bf-bf31-18b258c81b9e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:52.215632 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-45543a86-9444-46bf-bf31-18b258c81b9e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:52.216026 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-45543a86-9444-46bf-bf31-18b258c81b9e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:52.285704 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-45543a86-9444-46bf-bf31-18b258c81b9e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:52.285704 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-45543a86-9444-46bf-bf31-18b258c81b9e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081951 Jul 18 17:11:52.286175 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 749/1361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:52 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:52.294092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-20ba58c3-adf9-4996-b2d0-df2e3fb1b607 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:52.294812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-20ba58c3-adf9-4996-b2d0-df2e3fb1b607 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:52.301846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20ba58c3-adf9-4996-b2d0-df2e3fb1b607 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:52.302292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20ba58c3-adf9-4996-b2d0-df2e3fb1b607 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:52.303137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20ba58c3-adf9-4996-b2d0-df2e3fb1b607 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:52.303602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-20ba58c3-adf9-4996-b2d0-df2e3fb1b607 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:52.437336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-20ba58c3-adf9-4996-b2d0-df2e3fb1b607 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:52.445225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-20ba58c3-adf9-4996-b2d0-df2e3fb1b607 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155528 Jul 18 17:11:52.445816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 613/1362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:52 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:53.303021 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-670081a1-1efa-4e5a-bb8c-53613b4cfca6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:53.303682 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-670081a1-1efa-4e5a-bb8c-53613b4cfca6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:53.309735 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-670081a1-1efa-4e5a-bb8c-53613b4cfca6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:53.310181 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-670081a1-1efa-4e5a-bb8c-53613b4cfca6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:53.310930 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-670081a1-1efa-4e5a-bb8c-53613b4cfca6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:53.311361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-670081a1-1efa-4e5a-bb8c-53613b4cfca6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:53.372200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-670081a1-1efa-4e5a-bb8c-53613b4cfca6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:53.380060 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-670081a1-1efa-4e5a-bb8c-53613b4cfca6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.080868 Jul 18 17:11:53.380604 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 750/1363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:53 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:53.461600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f2304718-e86c-4ab6-b116-4d396fe3724b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:53.462222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f2304718-e86c-4ab6-b116-4d396fe3724b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:53.468721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2304718-e86c-4ab6-b116-4d396fe3724b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:53.469166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2304718-e86c-4ab6-b116-4d396fe3724b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:53.469915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2304718-e86c-4ab6-b116-4d396fe3724b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:53.470349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f2304718-e86c-4ab6-b116-4d396fe3724b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:53.598967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f2304718-e86c-4ab6-b116-4d396fe3724b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:53.607102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f2304718-e86c-4ab6-b116-4d396fe3724b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.149377 Jul 18 17:11:53.607687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 614/1364] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:53 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:54.397480 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-573209fc-75de-49b3-a710-9da0e96ab3c4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:54.398022 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-573209fc-75de-49b3-a710-9da0e96ab3c4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:54.404509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-573209fc-75de-49b3-a710-9da0e96ab3c4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:54.404960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-573209fc-75de-49b3-a710-9da0e96ab3c4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:54.405714 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-573209fc-75de-49b3-a710-9da0e96ab3c4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:54.406151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-573209fc-75de-49b3-a710-9da0e96ab3c4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:54.470039 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-573209fc-75de-49b3-a710-9da0e96ab3c4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:54.477944 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-573209fc-75de-49b3-a710-9da0e96ab3c4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084358 Jul 18 17:11:54.478496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 751/1365] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:54 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:54.624665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a73f861c-3a98-44e5-be48-276554ab3dd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:54.625273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a73f861c-3a98-44e5-be48-276554ab3dd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:54.631790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a73f861c-3a98-44e5-be48-276554ab3dd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:54.632313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a73f861c-3a98-44e5-be48-276554ab3dd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:54.633108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a73f861c-3a98-44e5-be48-276554ab3dd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:54.633574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a73f861c-3a98-44e5-be48-276554ab3dd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:54.772916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a73f861c-3a98-44e5-be48-276554ab3dd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:54.781524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a73f861c-3a98-44e5-be48-276554ab3dd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.161104 Jul 18 17:11:54.782094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 615/1366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:54 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:55.495324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-6a446669-9a6f-4eb3-ab91-dd9b4e414369 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:55.496647 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-6a446669-9a6f-4eb3-ab91-dd9b4e414369 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:55.502609 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6a446669-9a6f-4eb3-ab91-dd9b4e414369 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:55.503046 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6a446669-9a6f-4eb3-ab91-dd9b4e414369 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:55.503809 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6a446669-9a6f-4eb3-ab91-dd9b4e414369 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:55.504233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-6a446669-9a6f-4eb3-ab91-dd9b4e414369 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:55.567043 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-6a446669-9a6f-4eb3-ab91-dd9b4e414369 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:55.575042 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-6a446669-9a6f-4eb3-ab91-dd9b4e414369 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083528 Jul 18 17:11:55.575611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 752/1367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:55 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:55.799267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-210db692-0a17-4062-aa33-2ded38005650 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:55.799866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-210db692-0a17-4062-aa33-2ded38005650 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:55.806389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-210db692-0a17-4062-aa33-2ded38005650 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:55.806833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-210db692-0a17-4062-aa33-2ded38005650 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:55.807615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-210db692-0a17-4062-aa33-2ded38005650 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:55.808245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-210db692-0a17-4062-aa33-2ded38005650 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:55.938968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-210db692-0a17-4062-aa33-2ded38005650 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:55.947051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-210db692-0a17-4062-aa33-2ded38005650 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151956 Jul 18 17:11:55.947641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 616/1368] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:55 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:56.592047 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-ede5d842-51d7-499f-b1db-115b3b50c131 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:56.592657 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-ede5d842-51d7-499f-b1db-115b3b50c131 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:56.598715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ede5d842-51d7-499f-b1db-115b3b50c131 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:56.599166 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ede5d842-51d7-499f-b1db-115b3b50c131 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:56.599944 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ede5d842-51d7-499f-b1db-115b3b50c131 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:56.600374 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-ede5d842-51d7-499f-b1db-115b3b50c131 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:56.602876 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:11:56.661792 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-ede5d842-51d7-499f-b1db-115b3b50c131 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:56.670250 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-ede5d842-51d7-499f-b1db-115b3b50c131 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082682 Jul 18 17:11:56.670802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 753/1369] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:56 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:56.964285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-134d92f2-fb8a-4519-b792-f968eb64a4e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:56.964840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-134d92f2-fb8a-4519-b792-f968eb64a4e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:56.971603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-134d92f2-fb8a-4519-b792-f968eb64a4e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:56.972049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-134d92f2-fb8a-4519-b792-f968eb64a4e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:56.972900 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-134d92f2-fb8a-4519-b792-f968eb64a4e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:56.973340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-134d92f2-fb8a-4519-b792-f968eb64a4e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:57.104253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-134d92f2-fb8a-4519-b792-f968eb64a4e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:57.112754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-134d92f2-fb8a-4519-b792-f968eb64a4e0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152421 Jul 18 17:11:57.113324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 617/1370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:56 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:57.687727 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3f0fa12f-4f8c-449d-9f05-53bef2234295 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:57.688346 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3f0fa12f-4f8c-449d-9f05-53bef2234295 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:57.694427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f0fa12f-4f8c-449d-9f05-53bef2234295 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:57.694874 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f0fa12f-4f8c-449d-9f05-53bef2234295 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:57.695660 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f0fa12f-4f8c-449d-9f05-53bef2234295 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:57.696097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3f0fa12f-4f8c-449d-9f05-53bef2234295 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:57.756498 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3f0fa12f-4f8c-449d-9f05-53bef2234295 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:57.765201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3f0fa12f-4f8c-449d-9f05-53bef2234295 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081325 Jul 18 17:11:57.765754 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 754/1371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:57 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:58.130398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9ccaa9ab-3e4d-49df-a605-49c252f6e8ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:58.130999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9ccaa9ab-3e4d-49df-a605-49c252f6e8ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:58.137594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ccaa9ab-3e4d-49df-a605-49c252f6e8ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:58.138039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ccaa9ab-3e4d-49df-a605-49c252f6e8ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:58.138799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ccaa9ab-3e4d-49df-a605-49c252f6e8ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:58.139230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ccaa9ab-3e4d-49df-a605-49c252f6e8ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:58.287690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9ccaa9ab-3e4d-49df-a605-49c252f6e8ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:58.296227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9ccaa9ab-3e4d-49df-a605-49c252f6e8ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.169593 Jul 18 17:11:58.296802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 618/1372] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:58 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:58.781887 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4682c81c-d6dc-48de-bae7-32a42257555e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:58.782560 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4682c81c-d6dc-48de-bae7-32a42257555e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:58.788793 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4682c81c-d6dc-48de-bae7-32a42257555e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:58.789240 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4682c81c-d6dc-48de-bae7-32a42257555e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:58.789985 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4682c81c-d6dc-48de-bae7-32a42257555e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:58.790416 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4682c81c-d6dc-48de-bae7-32a42257555e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:58.857625 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4682c81c-d6dc-48de-bae7-32a42257555e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:58.866412 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4682c81c-d6dc-48de-bae7-32a42257555e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088420 Jul 18 17:11:58.866981 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 755/1373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:58 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:59.313879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2846ba9f-8b07-415c-a48c-8bee75d3fb76 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:59.314487 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2846ba9f-8b07-415c-a48c-8bee75d3fb76 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:59.321055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2846ba9f-8b07-415c-a48c-8bee75d3fb76 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:59.321505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2846ba9f-8b07-415c-a48c-8bee75d3fb76 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:59.322335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2846ba9f-8b07-415c-a48c-8bee75d3fb76 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:59.322783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2846ba9f-8b07-415c-a48c-8bee75d3fb76 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:59.453926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2846ba9f-8b07-415c-a48c-8bee75d3fb76 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:59.461951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2846ba9f-8b07-415c-a48c-8bee75d3fb76 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152005 Jul 18 17:11:59.462512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 619/1374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:59 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:11:59.889586 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-c152ad5f-11f5-4bae-b936-6e5037c66e02 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:11:59.890176 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-c152ad5f-11f5-4bae-b936-6e5037c66e02 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:11:59.896453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c152ad5f-11f5-4bae-b936-6e5037c66e02 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:59.896999 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c152ad5f-11f5-4bae-b936-6e5037c66e02 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:59.897664 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c152ad5f-11f5-4bae-b936-6e5037c66e02 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:11:59.898116 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-c152ad5f-11f5-4bae-b936-6e5037c66e02 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:11:59.962153 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-c152ad5f-11f5-4bae-b936-6e5037c66e02 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:11:59.971059 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-c152ad5f-11f5-4bae-b936-6e5037c66e02 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085428 Jul 18 17:11:59.971651 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 756/1375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:11:59 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:00.479072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-77d73255-23f6-49a8-951f-c313e3d968ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:00.479649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-77d73255-23f6-49a8-951f-c313e3d968ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:00.486783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77d73255-23f6-49a8-951f-c313e3d968ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:00.487229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77d73255-23f6-49a8-951f-c313e3d968ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:00.488040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77d73255-23f6-49a8-951f-c313e3d968ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:00.488473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77d73255-23f6-49a8-951f-c313e3d968ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:00.620172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-77d73255-23f6-49a8-951f-c313e3d968ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:00.628280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-77d73255-23f6-49a8-951f-c313e3d968ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153194 Jul 18 17:12:00.628853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 620/1376] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:00 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:00.989427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a4d9b38d-b562-4148-aa81-b5ac91835f9d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:00.990044 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a4d9b38d-b562-4148-aa81-b5ac91835f9d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:00.996403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a4d9b38d-b562-4148-aa81-b5ac91835f9d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:00.996812 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a4d9b38d-b562-4148-aa81-b5ac91835f9d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:00.997567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a4d9b38d-b562-4148-aa81-b5ac91835f9d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:00.998005 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a4d9b38d-b562-4148-aa81-b5ac91835f9d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:01.059983 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a4d9b38d-b562-4148-aa81-b5ac91835f9d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:01.067923 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a4d9b38d-b562-4148-aa81-b5ac91835f9d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082332 Jul 18 17:12:01.068479 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 757/1377] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:00 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:01.645913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0d44e8d9-c0ed-46da-bf50-abd794c840d2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:01.646511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0d44e8d9-c0ed-46da-bf50-abd794c840d2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:01.653599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d44e8d9-c0ed-46da-bf50-abd794c840d2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:01.654044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d44e8d9-c0ed-46da-bf50-abd794c840d2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:01.654805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d44e8d9-c0ed-46da-bf50-abd794c840d2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:01.655244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d44e8d9-c0ed-46da-bf50-abd794c840d2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:01.782755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0d44e8d9-c0ed-46da-bf50-abd794c840d2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:01.790620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0d44e8d9-c0ed-46da-bf50-abd794c840d2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.148561 Jul 18 17:12:01.791176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 621/1378] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:01 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:02.084728 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-da90376c-4d3b-4584-aeca-d0330d179258 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:02.085315 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-da90376c-4d3b-4584-aeca-d0330d179258 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:02.092414 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-da90376c-4d3b-4584-aeca-d0330d179258 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:02.092865 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-da90376c-4d3b-4584-aeca-d0330d179258 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:02.093623 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-da90376c-4d3b-4584-aeca-d0330d179258 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:02.094055 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-da90376c-4d3b-4584-aeca-d0330d179258 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:02.156496 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-da90376c-4d3b-4584-aeca-d0330d179258 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:02.164435 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-da90376c-4d3b-4584-aeca-d0330d179258 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083669 Jul 18 17:12:02.164979 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 758/1379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:02 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:02.809079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-434525d7-028d-4aed-8fa3-e0d5fe8142d8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:02.809704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-434525d7-028d-4aed-8fa3-e0d5fe8142d8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:02.816565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-434525d7-028d-4aed-8fa3-e0d5fe8142d8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:02.817018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-434525d7-028d-4aed-8fa3-e0d5fe8142d8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:02.817783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-434525d7-028d-4aed-8fa3-e0d5fe8142d8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:02.818224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-434525d7-028d-4aed-8fa3-e0d5fe8142d8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:02.948068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-434525d7-028d-4aed-8fa3-e0d5fe8142d8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:02.956214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-434525d7-028d-4aed-8fa3-e0d5fe8142d8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151534 Jul 18 17:12:02.956779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 622/1380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:02 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:03.181489 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cbd33f1c-26d9-4a0e-90d3-732664543984 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:03.182033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cbd33f1c-26d9-4a0e-90d3-732664543984 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:03.188006 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbd33f1c-26d9-4a0e-90d3-732664543984 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:03.188443 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbd33f1c-26d9-4a0e-90d3-732664543984 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:03.189189 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbd33f1c-26d9-4a0e-90d3-732664543984 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:03.189620 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cbd33f1c-26d9-4a0e-90d3-732664543984 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:03.253214 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cbd33f1c-26d9-4a0e-90d3-732664543984 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:03.261350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cbd33f1c-26d9-4a0e-90d3-732664543984 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083728 Jul 18 17:12:03.261902 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 759/1381] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:03 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:03.974198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-956ec981-32e8-4d0e-b9c2-1f5d7cb1bcd7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:03.974806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-956ec981-32e8-4d0e-b9c2-1f5d7cb1bcd7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:03.981543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-956ec981-32e8-4d0e-b9c2-1f5d7cb1bcd7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:03.981994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-956ec981-32e8-4d0e-b9c2-1f5d7cb1bcd7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:03.982772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-956ec981-32e8-4d0e-b9c2-1f5d7cb1bcd7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:03.983205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-956ec981-32e8-4d0e-b9c2-1f5d7cb1bcd7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:04.119333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-956ec981-32e8-4d0e-b9c2-1f5d7cb1bcd7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:04.128226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-956ec981-32e8-4d0e-b9c2-1f5d7cb1bcd7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157929 Jul 18 17:12:04.128800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 623/1382] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:03 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:04.277427 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-9b2264f8-d680-4efc-9afd-51a63c17a0e0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:04.278036 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-9b2264f8-d680-4efc-9afd-51a63c17a0e0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:04.284161 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b2264f8-d680-4efc-9afd-51a63c17a0e0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:04.284611 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b2264f8-d680-4efc-9afd-51a63c17a0e0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:04.285370 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b2264f8-d680-4efc-9afd-51a63c17a0e0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:04.285805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-9b2264f8-d680-4efc-9afd-51a63c17a0e0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:04.348129 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-9b2264f8-d680-4efc-9afd-51a63c17a0e0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:04.356761 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-9b2264f8-d680-4efc-9afd-51a63c17a0e0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083205 Jul 18 17:12:04.357253 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 760/1383] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:04 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:05.146499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7df7e1bd-5f3e-4706-a811-7a4a032e440c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:05.147040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7df7e1bd-5f3e-4706-a811-7a4a032e440c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:05.149683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=52 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:05.155252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7df7e1bd-5f3e-4706-a811-7a4a032e440c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:05.160849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7df7e1bd-5f3e-4706-a811-7a4a032e440c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:05.160849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7df7e1bd-5f3e-4706-a811-7a4a032e440c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:05.160849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7df7e1bd-5f3e-4706-a811-7a4a032e440c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:05.291773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7df7e1bd-5f3e-4706-a811-7a4a032e440c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:05.300290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7df7e1bd-5f3e-4706-a811-7a4a032e440c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157694 Jul 18 17:12:05.300851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 624/1384] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:05 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:05.373533 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-91e49d35-bdd2-4091-85d0-a1141c99545c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:05.374140 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-91e49d35-bdd2-4091-85d0-a1141c99545c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:05.380449 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-91e49d35-bdd2-4091-85d0-a1141c99545c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:05.380896 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-91e49d35-bdd2-4091-85d0-a1141c99545c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:05.381664 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-91e49d35-bdd2-4091-85d0-a1141c99545c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:05.382097 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-91e49d35-bdd2-4091-85d0-a1141c99545c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:05.443768 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-91e49d35-bdd2-4091-85d0-a1141c99545c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:05.452262 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-91e49d35-bdd2-4091-85d0-a1141c99545c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083395 Jul 18 17:12:05.452812 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 761/1385] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:05 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:06.318552 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-634c6407-4cee-4dcc-8ecd-7adb467d3c58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:06.319177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-634c6407-4cee-4dcc-8ecd-7adb467d3c58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:06.327433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-634c6407-4cee-4dcc-8ecd-7adb467d3c58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:06.327901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-634c6407-4cee-4dcc-8ecd-7adb467d3c58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:06.328662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-634c6407-4cee-4dcc-8ecd-7adb467d3c58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:06.329094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-634c6407-4cee-4dcc-8ecd-7adb467d3c58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:06.461689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-634c6407-4cee-4dcc-8ecd-7adb467d3c58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:06.469029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-87d85b67-5d26-4841-8105-ffb681632525 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:06.469643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-87d85b67-5d26-4841-8105-ffb681632525 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:06.470385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-634c6407-4cee-4dcc-8ecd-7adb467d3c58 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156096 Jul 18 17:12:06.470963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 625/1386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:06 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:06.472604 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=56 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:06.476110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-87d85b67-5d26-4841-8105-ffb681632525 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:06.476555 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-87d85b67-5d26-4841-8105-ffb681632525 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:06.477318 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-87d85b67-5d26-4841-8105-ffb681632525 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:06.477751 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-87d85b67-5d26-4841-8105-ffb681632525 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:06.538785 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-87d85b67-5d26-4841-8105-ffb681632525 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:06.547432 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-87d85b67-5d26-4841-8105-ffb681632525 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082388 Jul 18 17:12:06.548281 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 762/1387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:06 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:07.487652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9fbb9ea4-e690-48cc-a23a-6fdf93086e2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:07.488241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9fbb9ea4-e690-48cc-a23a-6fdf93086e2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:07.494824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ea4-e690-48cc-a23a-6fdf93086e2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:07.495285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ea4-e690-48cc-a23a-6fdf93086e2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:07.496058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ea4-e690-48cc-a23a-6fdf93086e2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:07.496653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fbb9ea4-e690-48cc-a23a-6fdf93086e2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:07.564568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-396e8f4c-f776-4040-a4e6-16673cd78425 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:07.565183 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-396e8f4c-f776-4040-a4e6-16673cd78425 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:07.571392 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-396e8f4c-f776-4040-a4e6-16673cd78425 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:07.572165 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-396e8f4c-f776-4040-a4e6-16673cd78425 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:07.572937 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-396e8f4c-f776-4040-a4e6-16673cd78425 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:07.573370 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-396e8f4c-f776-4040-a4e6-16673cd78425 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:07.638509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9fbb9ea4-e690-48cc-a23a-6fdf93086e2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:07.638509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9fbb9ea4-e690-48cc-a23a-6fdf93086e2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154651 Jul 18 17:12:07.638737 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-396e8f4c-f776-4040-a4e6-16673cd78425 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:07.639033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 626/1388] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:07 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:07.647168 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-396e8f4c-f776-4040-a4e6-16673cd78425 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086557 Jul 18 17:12:07.647748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 763/1389] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:07 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:08.656260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9b63c218-8f7b-4dba-930a-a26b21bcaf8a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:08.656864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9b63c218-8f7b-4dba-930a-a26b21bcaf8a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:08.663344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b63c218-8f7b-4dba-930a-a26b21bcaf8a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:08.663808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b63c218-8f7b-4dba-930a-a26b21bcaf8a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:08.663956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1895dedb-3a29-48c2-9157-0ec9e4898b24 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:08.664545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1895dedb-3a29-48c2-9157-0ec9e4898b24 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:08.664671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b63c218-8f7b-4dba-930a-a26b21bcaf8a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:08.665046 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b63c218-8f7b-4dba-930a-a26b21bcaf8a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:08.667587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:08.671538 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1895dedb-3a29-48c2-9157-0ec9e4898b24 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:08.671994 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1895dedb-3a29-48c2-9157-0ec9e4898b24 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:08.672762 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1895dedb-3a29-48c2-9157-0ec9e4898b24 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:08.673451 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1895dedb-3a29-48c2-9157-0ec9e4898b24 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:08.735147 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1895dedb-3a29-48c2-9157-0ec9e4898b24 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:08.743113 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1895dedb-3a29-48c2-9157-0ec9e4898b24 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082882 Jul 18 17:12:08.743732 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 764/1390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:08 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:08.801651 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9b63c218-8f7b-4dba-930a-a26b21bcaf8a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:08.809670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9b63c218-8f7b-4dba-930a-a26b21bcaf8a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.158027 Jul 18 17:12:08.810228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 627/1391] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:08 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:09.760188 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5325c500-f4a4-4edd-b15f-14938e989ba1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:09.760796 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5325c500-f4a4-4edd-b15f-14938e989ba1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:09.767556 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5325c500-f4a4-4edd-b15f-14938e989ba1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:09.768003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5325c500-f4a4-4edd-b15f-14938e989ba1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:09.768756 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5325c500-f4a4-4edd-b15f-14938e989ba1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:09.769190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5325c500-f4a4-4edd-b15f-14938e989ba1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:09.826813 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b76a8ce6-e344-4ac7-8ea8-2849172be566 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:09.827976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b76a8ce6-e344-4ac7-8ea8-2849172be566 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:09.832731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5325c500-f4a4-4edd-b15f-14938e989ba1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:09.835147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b76a8ce6-e344-4ac7-8ea8-2849172be566 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:09.835741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b76a8ce6-e344-4ac7-8ea8-2849172be566 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:09.837555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b76a8ce6-e344-4ac7-8ea8-2849172be566 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:09.837649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b76a8ce6-e344-4ac7-8ea8-2849172be566 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:09.843526 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5325c500-f4a4-4edd-b15f-14938e989ba1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086753 Jul 18 17:12:09.843526 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 765/1392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:09 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:10.070666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b76a8ce6-e344-4ac7-8ea8-2849172be566 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:10.079633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b76a8ce6-e344-4ac7-8ea8-2849172be566 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.257182 Jul 18 17:12:10.080147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 628/1393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:09 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:10.860499 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-309d9a0c-2efe-483d-8e3f-852821b47aa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:10.861126 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-309d9a0c-2efe-483d-8e3f-852821b47aa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:10.867263 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-309d9a0c-2efe-483d-8e3f-852821b47aa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:10.867731 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-309d9a0c-2efe-483d-8e3f-852821b47aa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:10.868484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-309d9a0c-2efe-483d-8e3f-852821b47aa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:10.868911 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-309d9a0c-2efe-483d-8e3f-852821b47aa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:10.930986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-309d9a0c-2efe-483d-8e3f-852821b47aa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:10.939969 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-309d9a0c-2efe-483d-8e3f-852821b47aa1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083673 Jul 18 17:12:10.940567 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 766/1394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:10 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:11.097308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-758196c7-cddf-4a1f-aa1e-bffe1fee75fb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:11.097854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-758196c7-cddf-4a1f-aa1e-bffe1fee75fb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:11.105259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-758196c7-cddf-4a1f-aa1e-bffe1fee75fb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:11.106235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-758196c7-cddf-4a1f-aa1e-bffe1fee75fb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:11.107105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-758196c7-cddf-4a1f-aa1e-bffe1fee75fb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:11.107587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-758196c7-cddf-4a1f-aa1e-bffe1fee75fb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:11.241802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-758196c7-cddf-4a1f-aa1e-bffe1fee75fb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:11.250009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-758196c7-cddf-4a1f-aa1e-bffe1fee75fb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156578 Jul 18 17:12:11.250593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 629/1395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:11 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:11.958738 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-99b1ecd5-17bf-4fb7-b87d-93d8a9b7df2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:11.959339 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-99b1ecd5-17bf-4fb7-b87d-93d8a9b7df2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:11.965455 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99b1ecd5-17bf-4fb7-b87d-93d8a9b7df2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:11.965986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99b1ecd5-17bf-4fb7-b87d-93d8a9b7df2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:11.966744 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99b1ecd5-17bf-4fb7-b87d-93d8a9b7df2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:11.967169 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-99b1ecd5-17bf-4fb7-b87d-93d8a9b7df2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:12.035267 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-99b1ecd5-17bf-4fb7-b87d-93d8a9b7df2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:12.045198 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-99b1ecd5-17bf-4fb7-b87d-93d8a9b7df2f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.090431 Jul 18 17:12:12.046231 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 767/1396] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:11 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:12.267345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-af8659e3-4eca-4e91-b105-327449c550cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:12.267975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-af8659e3-4eca-4e91-b105-327449c550cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:12.274553 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af8659e3-4eca-4e91-b105-327449c550cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:12.275001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af8659e3-4eca-4e91-b105-327449c550cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:12.275792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af8659e3-4eca-4e91-b105-327449c550cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:12.276230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af8659e3-4eca-4e91-b105-327449c550cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:12.413062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-af8659e3-4eca-4e91-b105-327449c550cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:12.421581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-af8659e3-4eca-4e91-b105-327449c550cd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.158083 Jul 18 17:12:12.422163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 630/1397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:12 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:13.063796 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-be3d8108-606e-410b-82de-7c47dd0aa8a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:13.064399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-be3d8108-606e-410b-82de-7c47dd0aa8a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:13.070384 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be3d8108-606e-410b-82de-7c47dd0aa8a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:13.070830 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be3d8108-606e-410b-82de-7c47dd0aa8a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:13.071603 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be3d8108-606e-410b-82de-7c47dd0aa8a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:13.072038 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-be3d8108-606e-410b-82de-7c47dd0aa8a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:13.135031 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-be3d8108-606e-410b-82de-7c47dd0aa8a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:13.143646 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-be3d8108-606e-410b-82de-7c47dd0aa8a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083709 Jul 18 17:12:13.144202 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 768/1398] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:13 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:13.438881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e1e58553-bfd4-43d5-b87e-b531ce397f6c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:13.439419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e1e58553-bfd4-43d5-b87e-b531ce397f6c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:13.446120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e1e58553-bfd4-43d5-b87e-b531ce397f6c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:13.446572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e1e58553-bfd4-43d5-b87e-b531ce397f6c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:13.447336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e1e58553-bfd4-43d5-b87e-b531ce397f6c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:13.447811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e1e58553-bfd4-43d5-b87e-b531ce397f6c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:13.576028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e1e58553-bfd4-43d5-b87e-b531ce397f6c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:13.584266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e1e58553-bfd4-43d5-b87e-b531ce397f6c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.149234 Jul 18 17:12:13.584807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 631/1399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:13 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:14.160315 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-d209a587-dc6b-46a3-8be3-a32f29514abe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:14.161001 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-d209a587-dc6b-46a3-8be3-a32f29514abe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:14.166939 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d209a587-dc6b-46a3-8be3-a32f29514abe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:14.167383 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d209a587-dc6b-46a3-8be3-a32f29514abe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:14.168715 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d209a587-dc6b-46a3-8be3-a32f29514abe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:14.169149 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-d209a587-dc6b-46a3-8be3-a32f29514abe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:14.229607 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-d209a587-dc6b-46a3-8be3-a32f29514abe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:14.232422 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:14.238769 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-d209a587-dc6b-46a3-8be3-a32f29514abe tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082325 Jul 18 17:12:14.239399 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 769/1400] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:14 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:14.602107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-200f91d6-dcfb-4097-9e69-9bee53f0b50a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:14.602694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-200f91d6-dcfb-4097-9e69-9bee53f0b50a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:14.610056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-200f91d6-dcfb-4097-9e69-9bee53f0b50a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:14.610508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-200f91d6-dcfb-4097-9e69-9bee53f0b50a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:14.611273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-200f91d6-dcfb-4097-9e69-9bee53f0b50a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:14.611741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-200f91d6-dcfb-4097-9e69-9bee53f0b50a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:14.744204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-200f91d6-dcfb-4097-9e69-9bee53f0b50a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:14.752359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-200f91d6-dcfb-4097-9e69-9bee53f0b50a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154097 Jul 18 17:12:14.752965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 632/1401] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:14 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:15.260636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e0c24909-f6ed-4d0c-b6d5-ba0d473570cf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:15.261249 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e0c24909-f6ed-4d0c-b6d5-ba0d473570cf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:15.268471 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e0c24909-f6ed-4d0c-b6d5-ba0d473570cf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:15.268915 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e0c24909-f6ed-4d0c-b6d5-ba0d473570cf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:15.269675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e0c24909-f6ed-4d0c-b6d5-ba0d473570cf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:15.270112 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e0c24909-f6ed-4d0c-b6d5-ba0d473570cf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:15.331705 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e0c24909-f6ed-4d0c-b6d5-ba0d473570cf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:15.339870 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e0c24909-f6ed-4d0c-b6d5-ba0d473570cf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082854 Jul 18 17:12:15.340223 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 770/1402] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:15 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:15.770221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-735cb563-3a29-4d84-9be2-1c3e2e47668f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:15.770822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-735cb563-3a29-4d84-9be2-1c3e2e47668f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:15.777417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-735cb563-3a29-4d84-9be2-1c3e2e47668f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:15.777938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-735cb563-3a29-4d84-9be2-1c3e2e47668f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:15.778687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-735cb563-3a29-4d84-9be2-1c3e2e47668f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:15.779117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-735cb563-3a29-4d84-9be2-1c3e2e47668f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:15.909476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-735cb563-3a29-4d84-9be2-1c3e2e47668f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:15.917490 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-735cb563-3a29-4d84-9be2-1c3e2e47668f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.151089 Jul 18 17:12:15.918621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 633/1403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:15 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:16.357103 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-60549fcb-f25a-4282-815c-0a4c284e4d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:16.357703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-60549fcb-f25a-4282-815c-0a4c284e4d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:16.363823 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60549fcb-f25a-4282-815c-0a4c284e4d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:16.364197 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60549fcb-f25a-4282-815c-0a4c284e4d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:16.364940 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60549fcb-f25a-4282-815c-0a4c284e4d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:16.365367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-60549fcb-f25a-4282-815c-0a4c284e4d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:16.430270 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-60549fcb-f25a-4282-815c-0a4c284e4d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:16.438514 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-60549fcb-f25a-4282-815c-0a4c284e4d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085375 Jul 18 17:12:16.439068 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 771/1404] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:16 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:16.935819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0ba4beac-9ece-4579-bc22-3b9ab9759d72 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:16.936429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0ba4beac-9ece-4579-bc22-3b9ab9759d72 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:16.942986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ba4beac-9ece-4579-bc22-3b9ab9759d72 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:16.943437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ba4beac-9ece-4579-bc22-3b9ab9759d72 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:16.944230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ba4beac-9ece-4579-bc22-3b9ab9759d72 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:16.944669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ba4beac-9ece-4579-bc22-3b9ab9759d72 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:17.076658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0ba4beac-9ece-4579-bc22-3b9ab9759d72 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:17.084685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0ba4beac-9ece-4579-bc22-3b9ab9759d72 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153321 Jul 18 17:12:17.085242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 634/1405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:16 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:17.455395 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-dd90fc72-f3de-4215-bf35-781a28a9264e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:17.456029 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-dd90fc72-f3de-4215-bf35-781a28a9264e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:17.462031 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd90fc72-f3de-4215-bf35-781a28a9264e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:17.462479 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd90fc72-f3de-4215-bf35-781a28a9264e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:17.463231 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd90fc72-f3de-4215-bf35-781a28a9264e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:17.463698 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-dd90fc72-f3de-4215-bf35-781a28a9264e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:17.524474 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-dd90fc72-f3de-4215-bf35-781a28a9264e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:17.533017 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-dd90fc72-f3de-4215-bf35-781a28a9264e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081439 Jul 18 17:12:17.533578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 772/1406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:17 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:18.102329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7c8c8765-7054-4076-934f-463525c3ce7b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:18.102938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7c8c8765-7054-4076-934f-463525c3ce7b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:18.109668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7c8c8765-7054-4076-934f-463525c3ce7b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:18.110123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7c8c8765-7054-4076-934f-463525c3ce7b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:18.111304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7c8c8765-7054-4076-934f-463525c3ce7b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:18.111985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7c8c8765-7054-4076-934f-463525c3ce7b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:18.247670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7c8c8765-7054-4076-934f-463525c3ce7b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:18.255748 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7c8c8765-7054-4076-934f-463525c3ce7b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.157402 Jul 18 17:12:18.258853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 635/1407] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:18 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:18.550755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3e822c09-f8b6-45cd-a965-89c1bb1ae14e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:18.551366 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3e822c09-f8b6-45cd-a965-89c1bb1ae14e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:18.557481 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e822c09-f8b6-45cd-a965-89c1bb1ae14e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:18.557924 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e822c09-f8b6-45cd-a965-89c1bb1ae14e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:18.558675 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e822c09-f8b6-45cd-a965-89c1bb1ae14e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:18.559280 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3e822c09-f8b6-45cd-a965-89c1bb1ae14e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:18.619718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3e822c09-f8b6-45cd-a965-89c1bb1ae14e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:18.628787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3e822c09-f8b6-45cd-a965-89c1bb1ae14e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082084 Jul 18 17:12:18.629364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 773/1408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:18 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:19.273699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b2fa5d61-5206-4e56-b780-20b6fd1844a7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:19.274298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b2fa5d61-5206-4e56-b780-20b6fd1844a7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:19.281649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2fa5d61-5206-4e56-b780-20b6fd1844a7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:19.282100 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2fa5d61-5206-4e56-b780-20b6fd1844a7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:19.282862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2fa5d61-5206-4e56-b780-20b6fd1844a7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:19.283296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2fa5d61-5206-4e56-b780-20b6fd1844a7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:19.414722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b2fa5d61-5206-4e56-b780-20b6fd1844a7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:19.422609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b2fa5d61-5206-4e56-b780-20b6fd1844a7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.152731 Jul 18 17:12:19.423428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 636/1409] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:19 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:19.645586 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-54ed6428-359f-4156-8655-92d86aac190f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:19.646168 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-54ed6428-359f-4156-8655-92d86aac190f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:19.652190 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54ed6428-359f-4156-8655-92d86aac190f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:19.652633 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54ed6428-359f-4156-8655-92d86aac190f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:19.653900 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54ed6428-359f-4156-8655-92d86aac190f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:19.654432 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-54ed6428-359f-4156-8655-92d86aac190f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:19.714983 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-54ed6428-359f-4156-8655-92d86aac190f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:19.723724 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-54ed6428-359f-4156-8655-92d86aac190f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081872 Jul 18 17:12:19.724281 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 774/1410] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:19 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:20.440404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f013e724-b82a-430d-be2d-4032e99cf61e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:20.440961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f013e724-b82a-430d-be2d-4032e99cf61e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:20.447810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f013e724-b82a-430d-be2d-4032e99cf61e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:20.448252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f013e724-b82a-430d-be2d-4032e99cf61e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:20.449002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f013e724-b82a-430d-be2d-4032e99cf61e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:20.449427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f013e724-b82a-430d-be2d-4032e99cf61e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:20.584019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f013e724-b82a-430d-be2d-4032e99cf61e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:20.592230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f013e724-b82a-430d-be2d-4032e99cf61e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155756 Jul 18 17:12:20.592796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 637/1411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:20 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:20.741208 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7cb98489-55b1-41c2-a495-a7d64a696f46 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:20.741766 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7cb98489-55b1-41c2-a495-a7d64a696f46 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:20.748750 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7cb98489-55b1-41c2-a495-a7d64a696f46 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:20.749216 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7cb98489-55b1-41c2-a495-a7d64a696f46 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:20.750038 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7cb98489-55b1-41c2-a495-a7d64a696f46 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:20.750470 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7cb98489-55b1-41c2-a495-a7d64a696f46 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:20.815899 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7cb98489-55b1-41c2-a495-a7d64a696f46 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:20.823867 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7cb98489-55b1-41c2-a495-a7d64a696f46 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086509 Jul 18 17:12:20.824419 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 775/1412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:20 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:21.609665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-10a0f3f3-2306-44d9-a3fc-637b20733d5f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:21.610317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-10a0f3f3-2306-44d9-a3fc-637b20733d5f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:21.617037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-10a0f3f3-2306-44d9-a3fc-637b20733d5f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:21.617478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-10a0f3f3-2306-44d9-a3fc-637b20733d5f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:21.618249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-10a0f3f3-2306-44d9-a3fc-637b20733d5f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:21.618686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-10a0f3f3-2306-44d9-a3fc-637b20733d5f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:21.748034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-10a0f3f3-2306-44d9-a3fc-637b20733d5f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:21.756031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-10a0f3f3-2306-44d9-a3fc-637b20733d5f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.150340 Jul 18 17:12:21.756601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 638/1413] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:21 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:21.841593 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-63831c29-c5cb-4ab1-ab61-f3d8b5320547 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:21.842366 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-63831c29-c5cb-4ab1-ab61-f3d8b5320547 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:21.848749 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63831c29-c5cb-4ab1-ab61-f3d8b5320547 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:21.849196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63831c29-c5cb-4ab1-ab61-f3d8b5320547 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:21.850087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63831c29-c5cb-4ab1-ab61-f3d8b5320547 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:21.850381 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-63831c29-c5cb-4ab1-ab61-f3d8b5320547 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:21.911736 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-63831c29-c5cb-4ab1-ab61-f3d8b5320547 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:21.921040 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-63831c29-c5cb-4ab1-ab61-f3d8b5320547 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083265 Jul 18 17:12:21.921605 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 776/1414] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:22.773601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-538dfab4-930d-4555-8e86-b9fa052a1fef tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:22.774227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-538dfab4-930d-4555-8e86-b9fa052a1fef tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:22.780968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-538dfab4-930d-4555-8e86-b9fa052a1fef tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:22.781407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-538dfab4-930d-4555-8e86-b9fa052a1fef tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:22.782152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-538dfab4-930d-4555-8e86-b9fa052a1fef tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:22.782581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-538dfab4-930d-4555-8e86-b9fa052a1fef tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:22.916253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-538dfab4-930d-4555-8e86-b9fa052a1fef tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:22.925062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-538dfab4-930d-4555-8e86-b9fa052a1fef tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.155262 Jul 18 17:12:22.925639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 639/1415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:22 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:22.937589 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a5549925-afeb-4d90-bdd6-5b363c7c736d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:22.938196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a5549925-afeb-4d90-bdd6-5b363c7c736d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:22.944215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a5549925-afeb-4d90-bdd6-5b363c7c736d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:22.944681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a5549925-afeb-4d90-bdd6-5b363c7c736d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:22.945440 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a5549925-afeb-4d90-bdd6-5b363c7c736d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:22.945866 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a5549925-afeb-4d90-bdd6-5b363c7c736d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:23.006719 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a5549925-afeb-4d90-bdd6-5b363c7c736d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:23.014636 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a5549925-afeb-4d90-bdd6-5b363c7c736d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081506 Jul 18 17:12:23.015201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 777/1416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:23.943335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-45ff1612-348d-4794-9c16-c787c830144c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:23.943915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-45ff1612-348d-4794-9c16-c787c830144c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:23.951192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45ff1612-348d-4794-9c16-c787c830144c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:23.951673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45ff1612-348d-4794-9c16-c787c830144c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:23.952438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45ff1612-348d-4794-9c16-c787c830144c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:23.952877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45ff1612-348d-4794-9c16-c787c830144c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:24.032272 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4c02a8b4-ae26-420e-ae2d-aa092a636572 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:24.032868 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4c02a8b4-ae26-420e-ae2d-aa092a636572 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:24.039324 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c02a8b4-ae26-420e-ae2d-aa092a636572 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:24.039802 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c02a8b4-ae26-420e-ae2d-aa092a636572 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:24.040575 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c02a8b4-ae26-420e-ae2d-aa092a636572 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:24.041009 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4c02a8b4-ae26-420e-ae2d-aa092a636572 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:24.084710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-45ff1612-348d-4794-9c16-c787c830144c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:24.092852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-45ff1612-348d-4794-9c16-c787c830144c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153470 Jul 18 17:12:24.093437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 640/1417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:23 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:24.104964 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4c02a8b4-ae26-420e-ae2d-aa092a636572 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:24.113279 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4c02a8b4-ae26-420e-ae2d-aa092a636572 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085619 Jul 18 17:12:24.114309 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 778/1418] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:25.110733 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6aa4797b-7686-48a7-8a65-61de1c7a7e08 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:25.111258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6aa4797b-7686-48a7-8a65-61de1c7a7e08 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:25.117950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6aa4797b-7686-48a7-8a65-61de1c7a7e08 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:25.118395 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6aa4797b-7686-48a7-8a65-61de1c7a7e08 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:25.119149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6aa4797b-7686-48a7-8a65-61de1c7a7e08 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:25.119620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6aa4797b-7686-48a7-8a65-61de1c7a7e08 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:25.134367 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-f8884963-9883-4337-9d67-b68aa8a0dcde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:25.135438 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-f8884963-9883-4337-9d67-b68aa8a0dcde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:25.145017 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f8884963-9883-4337-9d67-b68aa8a0dcde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:25.145748 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f8884963-9883-4337-9d67-b68aa8a0dcde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:25.146975 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f8884963-9883-4337-9d67-b68aa8a0dcde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:25.147702 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-f8884963-9883-4337-9d67-b68aa8a0dcde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:25.227180 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-f8884963-9883-4337-9d67-b68aa8a0dcde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:25.235364 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-f8884963-9883-4337-9d67-b68aa8a0dcde tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.107610 Jul 18 17:12:25.236160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 779/1419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:25.272392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6aa4797b-7686-48a7-8a65-61de1c7a7e08 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:25.281125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6aa4797b-7686-48a7-8a65-61de1c7a7e08 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.174326 Jul 18 17:12:25.281692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 641/1420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:25 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:26.252973 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-a963d66c-bfc8-45d9-95b2-9a168fcab67a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:26.253568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-a963d66c-bfc8-45d9-95b2-9a168fcab67a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:26.260921 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a963d66c-bfc8-45d9-95b2-9a168fcab67a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:26.264498 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a963d66c-bfc8-45d9-95b2-9a168fcab67a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:26.264498 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a963d66c-bfc8-45d9-95b2-9a168fcab67a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:26.264498 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-a963d66c-bfc8-45d9-95b2-9a168fcab67a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:26.298519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-550f4376-5399-4718-89c6-4cf3d9c3d0a1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:26.299106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-550f4376-5399-4718-89c6-4cf3d9c3d0a1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:26.305831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-550f4376-5399-4718-89c6-4cf3d9c3d0a1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:26.306529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-550f4376-5399-4718-89c6-4cf3d9c3d0a1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:26.307309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-550f4376-5399-4718-89c6-4cf3d9c3d0a1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:26.307768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-550f4376-5399-4718-89c6-4cf3d9c3d0a1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:26.327361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-a963d66c-bfc8-45d9-95b2-9a168fcab67a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:26.335759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-a963d66c-bfc8-45d9-95b2-9a168fcab67a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086643 Jul 18 17:12:26.336334 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 780/1421] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:26.447055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-550f4376-5399-4718-89c6-4cf3d9c3d0a1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:26.455090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-550f4376-5399-4718-89c6-4cf3d9c3d0a1 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.160685 Jul 18 17:12:26.455679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 642/1422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:26 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:27.353478 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2367c0fd-1cff-4e81-ac9b-dd82d105985a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:27.354089 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2367c0fd-1cff-4e81-ac9b-dd82d105985a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:27.364275 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2367c0fd-1cff-4e81-ac9b-dd82d105985a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:27.364723 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2367c0fd-1cff-4e81-ac9b-dd82d105985a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:27.365626 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2367c0fd-1cff-4e81-ac9b-dd82d105985a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:27.366075 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2367c0fd-1cff-4e81-ac9b-dd82d105985a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:27.433228 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2367c0fd-1cff-4e81-ac9b-dd82d105985a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:27.440648 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2367c0fd-1cff-4e81-ac9b-dd82d105985a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.091067 Jul 18 17:12:27.441215 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 781/1423] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:27.472271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3bc9ee55-a91f-4d36-8767-88be41965899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:27.472885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3bc9ee55-a91f-4d36-8767-88be41965899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:27.479297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3bc9ee55-a91f-4d36-8767-88be41965899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:27.479767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3bc9ee55-a91f-4d36-8767-88be41965899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:27.480567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3bc9ee55-a91f-4d36-8767-88be41965899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:27.481114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3bc9ee55-a91f-4d36-8767-88be41965899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:27.613746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3bc9ee55-a91f-4d36-8767-88be41965899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:27.616038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:27.622490 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3bc9ee55-a91f-4d36-8767-88be41965899 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.154005 Jul 18 17:12:27.623055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 643/1424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:27 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:28.457661 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-3d0571a6-b45d-4744-b1c7-e7f7e47a777d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:28.458207 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-3d0571a6-b45d-4744-b1c7-e7f7e47a777d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:28.464350 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d0571a6-b45d-4744-b1c7-e7f7e47a777d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:28.464880 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d0571a6-b45d-4744-b1c7-e7f7e47a777d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:28.465824 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d0571a6-b45d-4744-b1c7-e7f7e47a777d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:28.466249 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-3d0571a6-b45d-4744-b1c7-e7f7e47a777d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:28.529896 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-3d0571a6-b45d-4744-b1c7-e7f7e47a777d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:28.537907 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-3d0571a6-b45d-4744-b1c7-e7f7e47a777d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084166 Jul 18 17:12:28.538453 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 782/1425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:28 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:28.639921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5e457db7-e65a-4340-a4ae-8a0c7c2347e6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:28.640560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5e457db7-e65a-4340-a4ae-8a0c7c2347e6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:28.647730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5e457db7-e65a-4340-a4ae-8a0c7c2347e6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:28.648185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5e457db7-e65a-4340-a4ae-8a0c7c2347e6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:28.649068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5e457db7-e65a-4340-a4ae-8a0c7c2347e6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:28.649507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5e457db7-e65a-4340-a4ae-8a0c7c2347e6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:28.786162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5e457db7-e65a-4340-a4ae-8a0c7c2347e6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:28.794829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5e457db7-e65a-4340-a4ae-8a0c7c2347e6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.159159 Jul 18 17:12:28.795479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 644/1426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:28 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:29.555681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-693837f9-858a-4cb4-9730-0728583d1d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:29.556287 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-693837f9-858a-4cb4-9730-0728583d1d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:29.562494 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-693837f9-858a-4cb4-9730-0728583d1d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:29.563361 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-693837f9-858a-4cb4-9730-0728583d1d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:29.564160 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-693837f9-858a-4cb4-9730-0728583d1d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:29.564602 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-693837f9-858a-4cb4-9730-0728583d1d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:29.629320 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-693837f9-858a-4cb4-9730-0728583d1d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:29.637977 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-693837f9-858a-4cb4-9730-0728583d1d6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086471 Jul 18 17:12:29.638545 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 783/1427] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:29 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:29.812170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5897e939-3051-4289-ab29-591dc8ff3567 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:29.812693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5897e939-3051-4289-ab29-591dc8ff3567 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:29.819140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5897e939-3051-4289-ab29-591dc8ff3567 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:29.819630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5897e939-3051-4289-ab29-591dc8ff3567 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:29.820386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5897e939-3051-4289-ab29-591dc8ff3567 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:29.820822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5897e939-3051-4289-ab29-591dc8ff3567 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:29.954659 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5897e939-3051-4289-ab29-591dc8ff3567 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:29.961838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5897e939-3051-4289-ab29-591dc8ff3567 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153609 Jul 18 17:12:29.962413 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 645/1428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:29 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:30.655172 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-97afa44d-53cc-402b-992e-b2a2a64562f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:30.655811 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-97afa44d-53cc-402b-992e-b2a2a64562f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:30.661890 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97afa44d-53cc-402b-992e-b2a2a64562f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:30.662340 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97afa44d-53cc-402b-992e-b2a2a64562f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:30.663095 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97afa44d-53cc-402b-992e-b2a2a64562f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:30.663564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-97afa44d-53cc-402b-992e-b2a2a64562f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:30.724770 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-97afa44d-53cc-402b-992e-b2a2a64562f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:30.732786 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-97afa44d-53cc-402b-992e-b2a2a64562f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082262 Jul 18 17:12:30.733333 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 784/1429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:30.979876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-42c9367f-25ae-4ea1-8abb-9ed1383d561b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:30.980465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-42c9367f-25ae-4ea1-8abb-9ed1383d561b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:30.987046 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-42c9367f-25ae-4ea1-8abb-9ed1383d561b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:30.987511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-42c9367f-25ae-4ea1-8abb-9ed1383d561b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:30.988278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-42c9367f-25ae-4ea1-8abb-9ed1383d561b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:30.988711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-42c9367f-25ae-4ea1-8abb-9ed1383d561b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:31.124483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-42c9367f-25ae-4ea1-8abb-9ed1383d561b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:31.132565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-42c9367f-25ae-4ea1-8abb-9ed1383d561b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.156664 Jul 18 17:12:31.133118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 646/1430] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:30 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:31.749997 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-85c765db-af72-47eb-a68e-be8b0bed426b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:31.750604 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-85c765db-af72-47eb-a68e-be8b0bed426b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:31.756607 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-85c765db-af72-47eb-a68e-be8b0bed426b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:31.757053 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-85c765db-af72-47eb-a68e-be8b0bed426b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:31.757787 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-85c765db-af72-47eb-a68e-be8b0bed426b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:31.758209 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-85c765db-af72-47eb-a68e-be8b0bed426b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:31.819386 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-85c765db-af72-47eb-a68e-be8b0bed426b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:31.828591 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-85c765db-af72-47eb-a68e-be8b0bed426b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082705 Jul 18 17:12:31.829202 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 785/1431] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:32.150295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-873c0602-defe-4d8f-a831-160fe35bcab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:32.150894 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-873c0602-defe-4d8f-a831-160fe35bcab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:32.158458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-873c0602-defe-4d8f-a831-160fe35bcab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:32.158899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-873c0602-defe-4d8f-a831-160fe35bcab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:32.159686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-873c0602-defe-4d8f-a831-160fe35bcab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:32.160116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-873c0602-defe-4d8f-a831-160fe35bcab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:32.291858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-873c0602-defe-4d8f-a831-160fe35bcab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:32.300375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-873c0602-defe-4d8f-a831-160fe35bcab3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153672 Jul 18 17:12:32.300720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 647/1432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:32 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:32.847734 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-e5d89dae-f671-4b46-a727-e0674f5a5273 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:32.848339 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-e5d89dae-f671-4b46-a727-e0674f5a5273 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:32.856909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5d89dae-f671-4b46-a727-e0674f5a5273 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:32.857666 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5d89dae-f671-4b46-a727-e0674f5a5273 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:32.858755 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5d89dae-f671-4b46-a727-e0674f5a5273 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:32.859198 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-e5d89dae-f671-4b46-a727-e0674f5a5273 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:32.874478 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=100 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:32.927201 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-e5d89dae-f671-4b46-a727-e0674f5a5273 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:32.929639 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-e5d89dae-f671-4b46-a727-e0674f5a5273 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085723 Jul 18 17:12:32.930492 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 786/1433] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:33.317389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ff92a9c6-f7c6-4f09-a42c-9ca6e2bef2a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:33.318024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ff92a9c6-f7c6-4f09-a42c-9ca6e2bef2a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:33.324856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff92a9c6-f7c6-4f09-a42c-9ca6e2bef2a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:33.325303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff92a9c6-f7c6-4f09-a42c-9ca6e2bef2a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:33.326067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff92a9c6-f7c6-4f09-a42c-9ca6e2bef2a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:33.326507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff92a9c6-f7c6-4f09-a42c-9ca6e2bef2a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:33.458181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ff92a9c6-f7c6-4f09-a42c-9ca6e2bef2a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:33.467344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ff92a9c6-f7c6-4f09-a42c-9ca6e2bef2a6 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1561 microversion: 2.1 time: 0.153928 Jul 18 17:12:33.467934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 648/1434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:33 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:33.946468 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1563364b-849e-4ce1-ab60-5a916228b40a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:33.947013 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1563364b-849e-4ce1-ab60-5a916228b40a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:33.954313 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1563364b-849e-4ce1-ab60-5a916228b40a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:33.954773 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1563364b-849e-4ce1-ab60-5a916228b40a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:33.955555 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1563364b-849e-4ce1-ab60-5a916228b40a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:33.955986 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1563364b-849e-4ce1-ab60-5a916228b40a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:34.022909 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1563364b-849e-4ce1-ab60-5a916228b40a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:34.031525 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1563364b-849e-4ce1-ab60-5a916228b40a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088851 Jul 18 17:12:34.032110 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 787/1435] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:33 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:34.108907 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-e5deef28-fd9c-4eab-b8bf-32c0e13dd0da req-0682ef0d-8907-4fc0-a634-006999191e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295d078f-10f9-4a6d-a3c4-9636ef01a6f7", "name": "network-vif-deleted", "tag": "eee981c4-43b3-4282-bd21-b689754ea2dd"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:12:34.117424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-e5deef28-fd9c-4eab-b8bf-32c0e13dd0da req-0682ef0d-8907-4fc0-a634-006999191e11 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:34.119805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-e5deef28-fd9c-4eab-b8bf-32c0e13dd0da req-0682ef0d-8907-4fc0-a634-006999191e11 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:34.130233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-e5deef28-fd9c-4eab-b8bf-32c0e13dd0da req-0682ef0d-8907-4fc0-a634-006999191e11 service nova] Creating event network-vif-deleted:eee981c4-43b3-4282-bd21-b689754ea2dd for instance 295d078f-10f9-4a6d-a3c4-9636ef01a6f7 on hv-cinder-84617 Jul 18 17:12:34.133588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR oslo.messaging._drivers.impl_rabbit [req-e5deef28-fd9c-4eab-b8bf-32c0e13dd0da req-0682ef0d-8907-4fc0-a634-006999191e11 service nova] [d9576bc6-755c-4da2-9f48-d7c9211b5ef9] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 17:12:34.485711 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-4fa17bcb-7318-404c-8651-5367dc06a9a2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:34.486232 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-4fa17bcb-7318-404c-8651-5367dc06a9a2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:34.492291 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4fa17bcb-7318-404c-8651-5367dc06a9a2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:34.492734 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4fa17bcb-7318-404c-8651-5367dc06a9a2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:34.493484 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4fa17bcb-7318-404c-8651-5367dc06a9a2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:34.493917 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-4fa17bcb-7318-404c-8651-5367dc06a9a2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:34.555423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-4fa17bcb-7318-404c-8651-5367dc06a9a2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:34.563647 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-4fa17bcb-7318-404c-8651-5367dc06a9a2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082412 Jul 18 17:12:34.564200 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 788/1436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:34 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:35.049423 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-295ff0e9-9cda-4f74-b810-c388d72e0a99 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:35.050095 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-295ff0e9-9cda-4f74-b810-c388d72e0a99 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:35.056040 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-295ff0e9-9cda-4f74-b810-c388d72e0a99 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:35.056485 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-295ff0e9-9cda-4f74-b810-c388d72e0a99 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:35.057238 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-295ff0e9-9cda-4f74-b810-c388d72e0a99 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:35.057668 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-295ff0e9-9cda-4f74-b810-c388d72e0a99 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:35.118342 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-295ff0e9-9cda-4f74-b810-c388d72e0a99 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:35.126417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-295ff0e9-9cda-4f74-b810-c388d72e0a99 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081109 Jul 18 17:12:35.126992 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 789/1437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:35.140409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [req-e5deef28-fd9c-4eab-b8bf-32c0e13dd0da req-0682ef0d-8907-4fc0-a634-006999191e11 service nova] [d9576bc6-755c-4da2-9f48-d7c9211b5ef9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 60182. Jul 18 17:12:35.144032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-e5deef28-fd9c-4eab-b8bf-32c0e13dd0da req-0682ef0d-8907-4fc0-a634-006999191e11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.039324 Jul 18 17:12:35.144633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 649/1438] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:12:35.581255 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-542a1927-ccf0-45b6-9445-c9f89ba2a27a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:35.581849 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-542a1927-ccf0-45b6-9445-c9f89ba2a27a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:35.587824 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-542a1927-ccf0-45b6-9445-c9f89ba2a27a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:35.588254 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-542a1927-ccf0-45b6-9445-c9f89ba2a27a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:35.588995 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-542a1927-ccf0-45b6-9445-c9f89ba2a27a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:35.589417 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-542a1927-ccf0-45b6-9445-c9f89ba2a27a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:35.649559 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-542a1927-ccf0-45b6-9445-c9f89ba2a27a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:35.658353 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-542a1927-ccf0-45b6-9445-c9f89ba2a27a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.080969 Jul 18 17:12:35.658910 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 790/1439] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:35 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:36.144472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1fa25bbb-f812-482d-a8da-50124baeb3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:36.148911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1fa25bbb-f812-482d-a8da-50124baeb3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:36.148911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=52 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:36.152154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1fa25bbb-f812-482d-a8da-50124baeb3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:36.152600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1fa25bbb-f812-482d-a8da-50124baeb3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:36.154016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1fa25bbb-f812-482d-a8da-50124baeb3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:36.154453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1fa25bbb-f812-482d-a8da-50124baeb3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:36.222013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1fa25bbb-f812-482d-a8da-50124baeb3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:36.230209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1fa25bbb-f812-482d-a8da-50124baeb3bb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.090508 Jul 18 17:12:36.230771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 650/1440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:36 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:36.675620 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-7e21a741-3fe4-43e8-b7cc-91870d366d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:36.676287 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-7e21a741-3fe4-43e8-b7cc-91870d366d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:36.678144 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=58 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:36.682956 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e21a741-3fe4-43e8-b7cc-91870d366d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:36.683403 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e21a741-3fe4-43e8-b7cc-91870d366d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:36.684198 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e21a741-3fe4-43e8-b7cc-91870d366d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:36.684648 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-7e21a741-3fe4-43e8-b7cc-91870d366d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:36.747809 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-7e21a741-3fe4-43e8-b7cc-91870d366d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:36.755703 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-7e21a741-3fe4-43e8-b7cc-91870d366d8d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.084393 Jul 18 17:12:36.756258 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 791/1441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:36 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:37.248730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1c3d6f97-f515-4499-88c0-f5af9f69c482 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:37.249331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1c3d6f97-f515-4499-88c0-f5af9f69c482 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:37.256006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f97-f515-4499-88c0-f5af9f69c482 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:37.256455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f97-f515-4499-88c0-f5af9f69c482 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:37.257223 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f97-f515-4499-88c0-f5af9f69c482 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:37.257659 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c3d6f97-f515-4499-88c0-f5af9f69c482 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:37.318681 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1c3d6f97-f515-4499-88c0-f5af9f69c482 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:37.327210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1c3d6f97-f515-4499-88c0-f5af9f69c482 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083157 Jul 18 17:12:37.327795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 651/1442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:37 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:37.772948 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-09c17180-fa7d-4f0f-b694-a900bbcdfdc2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:37.773532 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-09c17180-fa7d-4f0f-b694-a900bbcdfdc2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:37.780234 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09c17180-fa7d-4f0f-b694-a900bbcdfdc2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:37.780669 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09c17180-fa7d-4f0f-b694-a900bbcdfdc2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:37.781416 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09c17180-fa7d-4f0f-b694-a900bbcdfdc2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:37.781844 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-09c17180-fa7d-4f0f-b694-a900bbcdfdc2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:37.845051 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-09c17180-fa7d-4f0f-b694-a900bbcdfdc2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:37.853195 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-09c17180-fa7d-4f0f-b694-a900bbcdfdc2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.084014 Jul 18 17:12:37.853759 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 792/1443] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:37 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:38.347286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f41e4f68-de35-478a-979d-dcf571983390 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:38.348227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f41e4f68-de35-478a-979d-dcf571983390 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:38.355672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f41e4f68-de35-478a-979d-dcf571983390 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:38.356809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f41e4f68-de35-478a-979d-dcf571983390 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:38.357688 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f41e4f68-de35-478a-979d-dcf571983390 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:38.358117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f41e4f68-de35-478a-979d-dcf571983390 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:38.424109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f41e4f68-de35-478a-979d-dcf571983390 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:38.432026 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f41e4f68-de35-478a-979d-dcf571983390 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.091694 Jul 18 17:12:38.432584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 652/1444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:38 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:38.869599 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5aeb424b-f38d-40b5-9274-19e3d27fe8cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:38.870208 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5aeb424b-f38d-40b5-9274-19e3d27fe8cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:38.876466 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5aeb424b-f38d-40b5-9274-19e3d27fe8cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:38.876941 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5aeb424b-f38d-40b5-9274-19e3d27fe8cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:38.877712 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5aeb424b-f38d-40b5-9274-19e3d27fe8cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:38.878131 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5aeb424b-f38d-40b5-9274-19e3d27fe8cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:38.941340 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5aeb424b-f38d-40b5-9274-19e3d27fe8cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:38.949283 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5aeb424b-f38d-40b5-9274-19e3d27fe8cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.083574 Jul 18 17:12:38.950813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 793/1445] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:38 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:39.450705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b75f6f7b-c311-4dc3-9fd4-9652c0403798 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:39.452416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b75f6f7b-c311-4dc3-9fd4-9652c0403798 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:39.459710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b75f6f7b-c311-4dc3-9fd4-9652c0403798 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:39.460434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b75f6f7b-c311-4dc3-9fd4-9652c0403798 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:39.461194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b75f6f7b-c311-4dc3-9fd4-9652c0403798 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:39.461627 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b75f6f7b-c311-4dc3-9fd4-9652c0403798 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:39.535005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b75f6f7b-c311-4dc3-9fd4-9652c0403798 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:39.545410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b75f6f7b-c311-4dc3-9fd4-9652c0403798 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.100002 Jul 18 17:12:39.546479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 653/1446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:39 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:39.967012 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-1b4d4cc7-762a-440a-baa3-d5c46659faa3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:39.968114 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-1b4d4cc7-762a-440a-baa3-d5c46659faa3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:39.974840 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b4d4cc7-762a-440a-baa3-d5c46659faa3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:39.975293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b4d4cc7-762a-440a-baa3-d5c46659faa3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:39.976100 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b4d4cc7-762a-440a-baa3-d5c46659faa3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:39.976534 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-1b4d4cc7-762a-440a-baa3-d5c46659faa3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:40.042766 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-1b4d4cc7-762a-440a-baa3-d5c46659faa3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:40.052681 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-1b4d4cc7-762a-440a-baa3-d5c46659faa3 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.090693 Jul 18 17:12:40.053256 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 794/1447] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:39 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:40.567619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d000db79-9ffc-4647-a26e-6e28169b69db tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:40.568225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d000db79-9ffc-4647-a26e-6e28169b69db tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:40.575439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d000db79-9ffc-4647-a26e-6e28169b69db tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:40.576019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d000db79-9ffc-4647-a26e-6e28169b69db tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:40.576773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d000db79-9ffc-4647-a26e-6e28169b69db tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:40.577208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d000db79-9ffc-4647-a26e-6e28169b69db tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:40.639372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d000db79-9ffc-4647-a26e-6e28169b69db tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:40.647625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d000db79-9ffc-4647-a26e-6e28169b69db tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083810 Jul 18 17:12:40.648230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 654/1448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:40 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:41.070321 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-2974cf9a-b3a4-4ebd-a34e-215135606c2e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:41.071018 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-2974cf9a-b3a4-4ebd-a34e-215135606c2e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:41.077547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2974cf9a-b3a4-4ebd-a34e-215135606c2e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:41.078033 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2974cf9a-b3a4-4ebd-a34e-215135606c2e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:41.078794 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2974cf9a-b3a4-4ebd-a34e-215135606c2e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:41.079233 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-2974cf9a-b3a4-4ebd-a34e-215135606c2e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:41.144491 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-2974cf9a-b3a4-4ebd-a34e-215135606c2e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:41.152391 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-2974cf9a-b3a4-4ebd-a34e-215135606c2e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.086132 Jul 18 17:12:41.153051 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 795/1449] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:41 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:41.663578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5ac78536-8a11-4a9e-82e0-d42dc0185024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:41.664233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5ac78536-8a11-4a9e-82e0-d42dc0185024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:41.671255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5ac78536-8a11-4a9e-82e0-d42dc0185024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:41.671734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5ac78536-8a11-4a9e-82e0-d42dc0185024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:41.672502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5ac78536-8a11-4a9e-82e0-d42dc0185024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:41.673200 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5ac78536-8a11-4a9e-82e0-d42dc0185024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:41.734585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5ac78536-8a11-4a9e-82e0-d42dc0185024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:41.742661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5ac78536-8a11-4a9e-82e0-d42dc0185024 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082914 Jul 18 17:12:41.743225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 655/1450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:41 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:42.169547 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5dcc4dab-193d-4444-8713-6efc50d9c2d4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:42.170184 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5dcc4dab-193d-4444-8713-6efc50d9c2d4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:42.176520 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5dcc4dab-193d-4444-8713-6efc50d9c2d4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:42.176965 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5dcc4dab-193d-4444-8713-6efc50d9c2d4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:42.177721 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5dcc4dab-193d-4444-8713-6efc50d9c2d4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:42.178156 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5dcc4dab-193d-4444-8713-6efc50d9c2d4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:42.242776 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5dcc4dab-193d-4444-8713-6efc50d9c2d4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:42.251575 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5dcc4dab-193d-4444-8713-6efc50d9c2d4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.086040 Jul 18 17:12:42.252139 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 796/1451] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:42 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:42.759029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d059c50a-be3f-43b1-9512-1e63b94cc6eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:42.759662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d059c50a-be3f-43b1-9512-1e63b94cc6eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:42.766238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d059c50a-be3f-43b1-9512-1e63b94cc6eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:42.766682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d059c50a-be3f-43b1-9512-1e63b94cc6eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:42.767437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d059c50a-be3f-43b1-9512-1e63b94cc6eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:42.767891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d059c50a-be3f-43b1-9512-1e63b94cc6eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:42.834738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d059c50a-be3f-43b1-9512-1e63b94cc6eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:42.843307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d059c50a-be3f-43b1-9512-1e63b94cc6eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088091 Jul 18 17:12:42.843906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 656/1452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:42 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:43.268989 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-cf91bacb-6882-4a87-9766-f7a47f47bfd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:43.269595 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-cf91bacb-6882-4a87-9766-f7a47f47bfd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:43.275758 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf91bacb-6882-4a87-9766-f7a47f47bfd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:43.276205 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf91bacb-6882-4a87-9766-f7a47f47bfd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:43.276961 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf91bacb-6882-4a87-9766-f7a47f47bfd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:43.277398 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-cf91bacb-6882-4a87-9766-f7a47f47bfd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:43.339242 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-cf91bacb-6882-4a87-9766-f7a47f47bfd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:43.347933 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-cf91bacb-6882-4a87-9766-f7a47f47bfd5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082664 Jul 18 17:12:43.348425 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 797/1453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:43 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:43.861143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bc49e5be-6ca7-45cf-a6c6-73d11bce6958 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:43.861788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bc49e5be-6ca7-45cf-a6c6-73d11bce6958 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:43.868773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc49e5be-6ca7-45cf-a6c6-73d11bce6958 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:43.869237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc49e5be-6ca7-45cf-a6c6-73d11bce6958 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:43.870219 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc49e5be-6ca7-45cf-a6c6-73d11bce6958 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:43.870716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc49e5be-6ca7-45cf-a6c6-73d11bce6958 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:43.933630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bc49e5be-6ca7-45cf-a6c6-73d11bce6958 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:43.942403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bc49e5be-6ca7-45cf-a6c6-73d11bce6958 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085279 Jul 18 17:12:43.942964 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 657/1454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:43 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:44.364946 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-510ffe80-1355-4226-9b90-a5f9769b43e9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:44.365578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-510ffe80-1355-4226-9b90-a5f9769b43e9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:44.371742 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-510ffe80-1355-4226-9b90-a5f9769b43e9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:44.372384 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-510ffe80-1355-4226-9b90-a5f9769b43e9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:44.373199 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-510ffe80-1355-4226-9b90-a5f9769b43e9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:44.373578 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-510ffe80-1355-4226-9b90-a5f9769b43e9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:44.434189 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-510ffe80-1355-4226-9b90-a5f9769b43e9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:44.442051 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-510ffe80-1355-4226-9b90-a5f9769b43e9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.080961 Jul 18 17:12:44.442606 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 798/1455] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:44 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:44.959442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-19105a4e-4a76-4fba-b4fd-61f70337cb75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:44.960055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-19105a4e-4a76-4fba-b4fd-61f70337cb75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:44.967333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19105a4e-4a76-4fba-b4fd-61f70337cb75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:44.967800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19105a4e-4a76-4fba-b4fd-61f70337cb75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:44.968569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19105a4e-4a76-4fba-b4fd-61f70337cb75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:44.968999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19105a4e-4a76-4fba-b4fd-61f70337cb75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:45.033192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-19105a4e-4a76-4fba-b4fd-61f70337cb75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:45.041465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-19105a4e-4a76-4fba-b4fd-61f70337cb75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085747 Jul 18 17:12:45.042038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 658/1456] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:44 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:45.458396 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.api.openstack.wsgi [None req-5c495be7-f4d9-4c4a-804a-9ee377be4dce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:45.458997 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.compute.api [None req-5c495be7-f4d9-4c4a-804a-9ee377be4dce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124945) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:45.466151 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c495be7-f4d9-4c4a-804a-9ee377be4dce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:45.466608 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c495be7-f4d9-4c4a-804a-9ee377be4dce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:45.467347 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c495be7-f4d9-4c4a-804a-9ee377be4dce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:45.467805 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG oslo_concurrency.lockutils [None req-5c495be7-f4d9-4c4a-804a-9ee377be4dce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:45.531649 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG nova.policy [None req-5c495be7-f4d9-4c4a-804a-9ee377be4dce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124945) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:45.541000 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO nova.api.openstack.requestlog [None req-5c495be7-f4d9-4c4a-804a-9ee377be4dce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.086424 Jul 18 17:12:45.541597 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: [pid: 124945|app: 0|req: 799/1457] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:45 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:46.059955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-000fe9bc-df2b-4648-8c70-63f4febc2f97 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:46.060625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-000fe9bc-df2b-4648-8c70-63f4febc2f97 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:46.067384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-000fe9bc-df2b-4648-8c70-63f4febc2f97 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:46.067862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-000fe9bc-df2b-4648-8c70-63f4febc2f97 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:46.068756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-000fe9bc-df2b-4648-8c70-63f4febc2f97 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:46.069193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-000fe9bc-df2b-4648-8c70-63f4febc2f97 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:46.132371 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-000fe9bc-df2b-4648-8c70-63f4febc2f97 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:46.141128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-000fe9bc-df2b-4648-8c70-63f4febc2f97 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085953 Jul 18 17:12:46.143594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 659/1458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:46 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:46.556568 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:12:46.559088 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:12:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:12:46.575933 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Traceback (most recent call last): Jul 18 17:12:46.576094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 18 17:12:46.576094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: timer() Jul 18 17:12:46.576094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 18 17:12:46.576094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: cb(*args, **kw) Jul 18 17:12:46.576094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 18 17:12:46.576094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: waiter.switch() Jul 18 17:12:46.576094 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: greenlet.error: cannot switch to a different thread Jul 18 17:12:47.158821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1b278576-c794-439a-91b5-f411408bd846 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:47.159418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1b278576-c794-439a-91b5-f411408bd846 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:47.165987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b278576-c794-439a-91b5-f411408bd846 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:47.166464 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b278576-c794-439a-91b5-f411408bd846 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:47.167281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b278576-c794-439a-91b5-f411408bd846 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:47.167795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b278576-c794-439a-91b5-f411408bd846 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:47.231777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1b278576-c794-439a-91b5-f411408bd846 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:47.239870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1b278576-c794-439a-91b5-f411408bd846 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085140 Jul 18 17:12:47.240427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 660/1459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:47 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:48.256976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d8a78365-2cbd-4167-ab43-1a83797719dd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:48.257649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d8a78365-2cbd-4167-ab43-1a83797719dd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:48.264414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8a78365-2cbd-4167-ab43-1a83797719dd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:48.264862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8a78365-2cbd-4167-ab43-1a83797719dd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:48.265618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8a78365-2cbd-4167-ab43-1a83797719dd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:48.266056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8a78365-2cbd-4167-ab43-1a83797719dd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:48.268669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:48.331426 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d8a78365-2cbd-4167-ab43-1a83797719dd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:48.339635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d8a78365-2cbd-4167-ab43-1a83797719dd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086410 Jul 18 17:12:48.341115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 661/1460] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:48 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:49.357697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9bd24ab4-a4bd-4f8f-b71b-ced115705dbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:49.358383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9bd24ab4-a4bd-4f8f-b71b-ced115705dbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:49.364717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9bd24ab4-a4bd-4f8f-b71b-ced115705dbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:49.365154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9bd24ab4-a4bd-4f8f-b71b-ced115705dbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:49.365898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9bd24ab4-a4bd-4f8f-b71b-ced115705dbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:49.366349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9bd24ab4-a4bd-4f8f-b71b-ced115705dbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:49.427326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9bd24ab4-a4bd-4f8f-b71b-ced115705dbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:49.436135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9bd24ab4-a4bd-4f8f-b71b-ced115705dbb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082752 Jul 18 17:12:49.436696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 662/1461] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:49 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:49.958494 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:12:49.958726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:12:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:12:50.452784 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-584cc895-3c60-4129-ab14-d34c217a06c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:50.453448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-584cc895-3c60-4129-ab14-d34c217a06c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:50.460414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584cc895-3c60-4129-ab14-d34c217a06c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:50.460863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584cc895-3c60-4129-ab14-d34c217a06c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:50.461624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584cc895-3c60-4129-ab14-d34c217a06c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:50.462109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584cc895-3c60-4129-ab14-d34c217a06c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:50.525250 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-584cc895-3c60-4129-ab14-d34c217a06c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:50.533475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-584cc895-3c60-4129-ab14-d34c217a06c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085411 Jul 18 17:12:50.534037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 663/1462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:50 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:51.550195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4ace9dcf-4165-4800-a102-a16c04b77acb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:51.550914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4ace9dcf-4165-4800-a102-a16c04b77acb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:51.557339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ace9dcf-4165-4800-a102-a16c04b77acb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:51.557781 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ace9dcf-4165-4800-a102-a16c04b77acb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:51.558529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ace9dcf-4165-4800-a102-a16c04b77acb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:51.559033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ace9dcf-4165-4800-a102-a16c04b77acb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:51.622440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4ace9dcf-4165-4800-a102-a16c04b77acb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:51.630561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4ace9dcf-4165-4800-a102-a16c04b77acb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084480 Jul 18 17:12:51.631131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 664/1463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:51 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:52.648046 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-85cbfed7-34b5-47fc-82bb-e9960e9d2e76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:52.648746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-85cbfed7-34b5-47fc-82bb-e9960e9d2e76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:52.655761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85cbfed7-34b5-47fc-82bb-e9960e9d2e76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:52.656214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85cbfed7-34b5-47fc-82bb-e9960e9d2e76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:52.656981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85cbfed7-34b5-47fc-82bb-e9960e9d2e76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:52.657419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85cbfed7-34b5-47fc-82bb-e9960e9d2e76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:52.729388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-85cbfed7-34b5-47fc-82bb-e9960e9d2e76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:52.739657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-85cbfed7-34b5-47fc-82bb-e9960e9d2e76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.095404 Jul 18 17:12:52.740234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 665/1464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:52 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:53.757012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0251e1a6-b526-4342-97bd-97cbc6633d07 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:53.757686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0251e1a6-b526-4342-97bd-97cbc6633d07 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:53.764140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0251e1a6-b526-4342-97bd-97cbc6633d07 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:53.764585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0251e1a6-b526-4342-97bd-97cbc6633d07 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:53.765341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0251e1a6-b526-4342-97bd-97cbc6633d07 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:53.765780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0251e1a6-b526-4342-97bd-97cbc6633d07 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:53.826987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0251e1a6-b526-4342-97bd-97cbc6633d07 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:53.836074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0251e1a6-b526-4342-97bd-97cbc6633d07 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082844 Jul 18 17:12:53.836654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 666/1465] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:53 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:54.853255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b3dd43a8-66ab-4e61-89e4-fa7829bc7542 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:54.853869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b3dd43a8-66ab-4e61-89e4-fa7829bc7542 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:54.861235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3dd43a8-66ab-4e61-89e4-fa7829bc7542 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:54.861677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3dd43a8-66ab-4e61-89e4-fa7829bc7542 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:54.862484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3dd43a8-66ab-4e61-89e4-fa7829bc7542 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:54.862920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3dd43a8-66ab-4e61-89e4-fa7829bc7542 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:54.924504 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b3dd43a8-66ab-4e61-89e4-fa7829bc7542 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:54.932448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b3dd43a8-66ab-4e61-89e4-fa7829bc7542 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083079 Jul 18 17:12:54.933037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 667/1466] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:54 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:55.462277 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_api:SELECT=17 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:55.536551 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: DEBUG dbcounter [-] [124945] Writing DB stats nova_cell1:SELECT=81 {{(pid=124945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:12:55.949751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6f65c4d2-3717-4a9e-a9e0-0655d1fea7d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:55.950383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6f65c4d2-3717-4a9e-a9e0-0655d1fea7d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:55.956827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f65c4d2-3717-4a9e-a9e0-0655d1fea7d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:55.957264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f65c4d2-3717-4a9e-a9e0-0655d1fea7d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:55.958014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f65c4d2-3717-4a9e-a9e0-0655d1fea7d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:55.958441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f65c4d2-3717-4a9e-a9e0-0655d1fea7d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:56.023049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6f65c4d2-3717-4a9e-a9e0-0655d1fea7d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:56.031310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6f65c4d2-3717-4a9e-a9e0-0655d1fea7d8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085505 Jul 18 17:12:56.035235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 668/1467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:55 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:12:57.048758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c3daa558-1528-4780-9efe-7e2fc98a8078 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:57.050061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c3daa558-1528-4780-9efe-7e2fc98a8078 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:57.057138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c3daa558-1528-4780-9efe-7e2fc98a8078 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:57.057583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c3daa558-1528-4780-9efe-7e2fc98a8078 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:57.058406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c3daa558-1528-4780-9efe-7e2fc98a8078 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:57.058845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c3daa558-1528-4780-9efe-7e2fc98a8078 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:57.124513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c3daa558-1528-4780-9efe-7e2fc98a8078 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:57.132511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c3daa558-1528-4780-9efe-7e2fc98a8078 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087862 Jul 18 17:12:57.133073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 669/1468] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:57 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:58.149630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-db51c44b-1da8-422a-b114-612f7eb85c96 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:58.150230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-db51c44b-1da8-422a-b114-612f7eb85c96 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:58.157585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db51c44b-1da8-422a-b114-612f7eb85c96 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:58.158026 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db51c44b-1da8-422a-b114-612f7eb85c96 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:58.158784 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db51c44b-1da8-422a-b114-612f7eb85c96 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:58.159218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db51c44b-1da8-422a-b114-612f7eb85c96 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:58.222604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-db51c44b-1da8-422a-b114-612f7eb85c96 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:58.230611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-db51c44b-1da8-422a-b114-612f7eb85c96 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084791 Jul 18 17:12:58.231402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 670/1469] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:58 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:12:59.250559 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4ff28eac-f18c-4832-be80-317c31d5f6cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:12:59.251245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4ff28eac-f18c-4832-be80-317c31d5f6cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:12:59.257717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ff28eac-f18c-4832-be80-317c31d5f6cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:59.258161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ff28eac-f18c-4832-be80-317c31d5f6cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:59.258918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ff28eac-f18c-4832-be80-317c31d5f6cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:12:59.259346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ff28eac-f18c-4832-be80-317c31d5f6cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:12:59.320003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4ff28eac-f18c-4832-be80-317c31d5f6cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:12:59.327880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4ff28eac-f18c-4832-be80-317c31d5f6cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083824 Jul 18 17:12:59.328432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 671/1470] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:12:59 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:00.345127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-eaaab557-3b8b-4879-97ef-206b98f55da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:00.345833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-eaaab557-3b8b-4879-97ef-206b98f55da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:00.352530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eaaab557-3b8b-4879-97ef-206b98f55da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:00.356645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eaaab557-3b8b-4879-97ef-206b98f55da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:00.356645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eaaab557-3b8b-4879-97ef-206b98f55da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:00.356645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eaaab557-3b8b-4879-97ef-206b98f55da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:00.420469 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-eaaab557-3b8b-4879-97ef-206b98f55da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:00.428203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-eaaab557-3b8b-4879-97ef-206b98f55da1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086919 Jul 18 17:13:00.428765 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 672/1471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:00 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:01.444909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d9e7ef34-6463-4510-8a40-b47e842420ac tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:01.445593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d9e7ef34-6463-4510-8a40-b47e842420ac tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:01.452422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9e7ef34-6463-4510-8a40-b47e842420ac tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:01.452874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9e7ef34-6463-4510-8a40-b47e842420ac tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:01.453635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9e7ef34-6463-4510-8a40-b47e842420ac tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:01.454074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9e7ef34-6463-4510-8a40-b47e842420ac tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:01.514214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d9e7ef34-6463-4510-8a40-b47e842420ac tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:01.522147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d9e7ef34-6463-4510-8a40-b47e842420ac tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081035 Jul 18 17:13:01.522708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 673/1472] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:01 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:02.540192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-36fa1b98-f36b-4ef9-9555-ea641c2a5b51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:02.540871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-36fa1b98-f36b-4ef9-9555-ea641c2a5b51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:02.548287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36fa1b98-f36b-4ef9-9555-ea641c2a5b51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:02.548727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36fa1b98-f36b-4ef9-9555-ea641c2a5b51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:02.549485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36fa1b98-f36b-4ef9-9555-ea641c2a5b51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:02.549918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36fa1b98-f36b-4ef9-9555-ea641c2a5b51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:02.611772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-36fa1b98-f36b-4ef9-9555-ea641c2a5b51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:02.619998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-36fa1b98-f36b-4ef9-9555-ea641c2a5b51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083849 Jul 18 17:13:02.620556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 674/1473] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:02 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:03.636946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-793945b3-332d-4b93-b7a7-6e8f9651de93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:03.637740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-793945b3-332d-4b93-b7a7-6e8f9651de93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:03.644654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-793945b3-332d-4b93-b7a7-6e8f9651de93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:03.645104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-793945b3-332d-4b93-b7a7-6e8f9651de93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:03.645880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-793945b3-332d-4b93-b7a7-6e8f9651de93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:03.646315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-793945b3-332d-4b93-b7a7-6e8f9651de93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:03.710337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-793945b3-332d-4b93-b7a7-6e8f9651de93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:03.718577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-793945b3-332d-4b93-b7a7-6e8f9651de93 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085457 Jul 18 17:13:03.719135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 675/1474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:03 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:04.735523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5379378c-9c00-47f6-ab89-af7d3f4a98de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:04.736226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5379378c-9c00-47f6-ab89-af7d3f4a98de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:04.742251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5379378c-9c00-47f6-ab89-af7d3f4a98de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:04.742691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5379378c-9c00-47f6-ab89-af7d3f4a98de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:04.743470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5379378c-9c00-47f6-ab89-af7d3f4a98de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:04.743918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5379378c-9c00-47f6-ab89-af7d3f4a98de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:04.808993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5379378c-9c00-47f6-ab89-af7d3f4a98de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:04.817032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5379378c-9c00-47f6-ab89-af7d3f4a98de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085377 Jul 18 17:13:04.817597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 676/1475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:04 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:05.834135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ea7abf75-7034-4d32-a2b0-f8301ccc41c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:05.834789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ea7abf75-7034-4d32-a2b0-f8301ccc41c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:05.841597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea7abf75-7034-4d32-a2b0-f8301ccc41c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:05.972017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea7abf75-7034-4d32-a2b0-f8301ccc41c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:05.972017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea7abf75-7034-4d32-a2b0-f8301ccc41c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:05.972017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea7abf75-7034-4d32-a2b0-f8301ccc41c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:05.972947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea7abf75-7034-4d32-a2b0-f8301ccc41c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:05.972947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:13:05.972947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ea7abf75-7034-4d32-a2b0-f8301ccc41c0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.090065 Jul 18 17:13:05.972947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 677/1476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:05 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:06.942962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6a21de35-042c-4ffc-9d68-fd83e0001a19 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:06.943736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6a21de35-042c-4ffc-9d68-fd83e0001a19 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:06.945853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=56 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:13:06.952057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a21de35-042c-4ffc-9d68-fd83e0001a19 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:06.952501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a21de35-042c-4ffc-9d68-fd83e0001a19 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:06.953256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a21de35-042c-4ffc-9d68-fd83e0001a19 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:06.953690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a21de35-042c-4ffc-9d68-fd83e0001a19 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:07.017529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6a21de35-042c-4ffc-9d68-fd83e0001a19 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:07.025461 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6a21de35-042c-4ffc-9d68-fd83e0001a19 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.091583 Jul 18 17:13:07.026023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 678/1477] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:06 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:08.042254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d1348a5e-0ee7-49f8-9285-03c333b4960d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:08.043066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d1348a5e-0ee7-49f8-9285-03c333b4960d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:08.049935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d1348a5e-0ee7-49f8-9285-03c333b4960d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:08.050387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d1348a5e-0ee7-49f8-9285-03c333b4960d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:08.051150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d1348a5e-0ee7-49f8-9285-03c333b4960d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:08.051622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d1348a5e-0ee7-49f8-9285-03c333b4960d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:08.113258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d1348a5e-0ee7-49f8-9285-03c333b4960d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:08.121294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d1348a5e-0ee7-49f8-9285-03c333b4960d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082726 Jul 18 17:13:08.122026 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 679/1478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:08 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:09.139138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-31d611eb-145b-4471-8272-37092926ea17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:09.139835 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-31d611eb-145b-4471-8272-37092926ea17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:09.146200 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-31d611eb-145b-4471-8272-37092926ea17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:09.146647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-31d611eb-145b-4471-8272-37092926ea17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:09.147402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-31d611eb-145b-4471-8272-37092926ea17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:09.147864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-31d611eb-145b-4471-8272-37092926ea17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:09.212494 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-31d611eb-145b-4471-8272-37092926ea17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:09.220624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-31d611eb-145b-4471-8272-37092926ea17 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086163 Jul 18 17:13:09.221190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 680/1479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:09 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:10.237509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8a89e0f4-cf36-4579-b396-88d02649c32b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:10.238179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8a89e0f4-cf36-4579-b396-88d02649c32b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:10.247358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8a89e0f4-cf36-4579-b396-88d02649c32b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:10.247886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8a89e0f4-cf36-4579-b396-88d02649c32b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:10.248674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8a89e0f4-cf36-4579-b396-88d02649c32b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:10.249118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8a89e0f4-cf36-4579-b396-88d02649c32b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:10.312161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8a89e0f4-cf36-4579-b396-88d02649c32b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:10.320224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8a89e0f4-cf36-4579-b396-88d02649c32b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086584 Jul 18 17:13:10.320796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 681/1480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:10 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:11.337877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f25edaa3-18f2-49b5-a677-e8fec4f713f0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:11.338551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f25edaa3-18f2-49b5-a677-e8fec4f713f0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:11.345223 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f25edaa3-18f2-49b5-a677-e8fec4f713f0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:11.345667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f25edaa3-18f2-49b5-a677-e8fec4f713f0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:11.346424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f25edaa3-18f2-49b5-a677-e8fec4f713f0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:11.346860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f25edaa3-18f2-49b5-a677-e8fec4f713f0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:11.410105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f25edaa3-18f2-49b5-a677-e8fec4f713f0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:11.418112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f25edaa3-18f2-49b5-a677-e8fec4f713f0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084038 Jul 18 17:13:11.418680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 682/1481] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:11 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:12.436092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bdc6c53d-18a1-43bc-956d-43cc4a633537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:12.436734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bdc6c53d-18a1-43bc-956d-43cc4a633537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:12.443429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bdc6c53d-18a1-43bc-956d-43cc4a633537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:12.443908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bdc6c53d-18a1-43bc-956d-43cc4a633537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:12.444676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bdc6c53d-18a1-43bc-956d-43cc4a633537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:12.445119 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bdc6c53d-18a1-43bc-956d-43cc4a633537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:12.511164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bdc6c53d-18a1-43bc-956d-43cc4a633537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:12.519398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bdc6c53d-18a1-43bc-956d-43cc4a633537 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087850 Jul 18 17:13:12.520003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 683/1482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:12 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:13.536504 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3d5beca7-0a90-490e-95e3-c01675775638 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:13.537192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3d5beca7-0a90-490e-95e3-c01675775638 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:13.544212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d5beca7-0a90-490e-95e3-c01675775638 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:13.544662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d5beca7-0a90-490e-95e3-c01675775638 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:13.545433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d5beca7-0a90-490e-95e3-c01675775638 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:13.545871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d5beca7-0a90-490e-95e3-c01675775638 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:13.607646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3d5beca7-0a90-490e-95e3-c01675775638 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:13.615554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3d5beca7-0a90-490e-95e3-c01675775638 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082907 Jul 18 17:13:13.616101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 684/1483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:13 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:14.632946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-39746282-5f0c-462f-89e0-d9f50f98f007 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:14.633624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-39746282-5f0c-462f-89e0-d9f50f98f007 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:14.640620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-39746282-5f0c-462f-89e0-d9f50f98f007 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:14.641058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-39746282-5f0c-462f-89e0-d9f50f98f007 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:14.641803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-39746282-5f0c-462f-89e0-d9f50f98f007 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:14.642230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-39746282-5f0c-462f-89e0-d9f50f98f007 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:14.704002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-39746282-5f0c-462f-89e0-d9f50f98f007 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:14.711992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-39746282-5f0c-462f-89e0-d9f50f98f007 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082820 Jul 18 17:13:14.712561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 685/1484] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:14 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:15.729830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f7bfb99d-702e-40a1-9afb-32f463c571b2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:15.730780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f7bfb99d-702e-40a1-9afb-32f463c571b2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:15.737321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7bfb99d-702e-40a1-9afb-32f463c571b2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:15.737768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7bfb99d-702e-40a1-9afb-32f463c571b2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:15.738532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7bfb99d-702e-40a1-9afb-32f463c571b2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:15.738976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7bfb99d-702e-40a1-9afb-32f463c571b2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:15.800958 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f7bfb99d-702e-40a1-9afb-32f463c571b2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:15.809989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f7bfb99d-702e-40a1-9afb-32f463c571b2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084014 Jul 18 17:13:15.810551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 686/1485] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:15 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:16.827027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2556bf9a-750c-4990-8ce2-922948299207 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:16.827744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2556bf9a-750c-4990-8ce2-922948299207 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:16.834505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2556bf9a-750c-4990-8ce2-922948299207 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:16.834959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2556bf9a-750c-4990-8ce2-922948299207 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:16.836168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2556bf9a-750c-4990-8ce2-922948299207 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:16.836294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2556bf9a-750c-4990-8ce2-922948299207 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:16.901858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2556bf9a-750c-4990-8ce2-922948299207 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:16.909885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2556bf9a-750c-4990-8ce2-922948299207 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087506 Jul 18 17:13:16.910466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 687/1486] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:16 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:17.927580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-76a4129e-3100-48cb-b516-b2887118ceed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:17.928286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-76a4129e-3100-48cb-b516-b2887118ceed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:17.935932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-76a4129e-3100-48cb-b516-b2887118ceed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:17.936367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-76a4129e-3100-48cb-b516-b2887118ceed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:17.937118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-76a4129e-3100-48cb-b516-b2887118ceed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:17.937545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-76a4129e-3100-48cb-b516-b2887118ceed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:18.001086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-76a4129e-3100-48cb-b516-b2887118ceed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:18.008916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-76a4129e-3100-48cb-b516-b2887118ceed tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085257 Jul 18 17:13:18.009481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 688/1487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:17 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:19.026381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c4962651-7129-4737-bf4a-021011bc29a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:19.027360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c4962651-7129-4737-bf4a-021011bc29a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:19.037251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4962651-7129-4737-bf4a-021011bc29a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:19.037251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4962651-7129-4737-bf4a-021011bc29a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:19.037251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4962651-7129-4737-bf4a-021011bc29a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:19.037251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4962651-7129-4737-bf4a-021011bc29a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:19.097932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c4962651-7129-4737-bf4a-021011bc29a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:19.106026 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c4962651-7129-4737-bf4a-021011bc29a9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083657 Jul 18 17:13:19.106584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 689/1488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:19 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:20.122407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7a3e31f2-4d3f-460f-8f3e-39cbbd928bd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:20.123100 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7a3e31f2-4d3f-460f-8f3e-39cbbd928bd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:20.129555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a3e31f2-4d3f-460f-8f3e-39cbbd928bd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:20.130005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a3e31f2-4d3f-460f-8f3e-39cbbd928bd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:20.130776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a3e31f2-4d3f-460f-8f3e-39cbbd928bd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:20.131211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a3e31f2-4d3f-460f-8f3e-39cbbd928bd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:20.194881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7a3e31f2-4d3f-460f-8f3e-39cbbd928bd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:20.203541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7a3e31f2-4d3f-460f-8f3e-39cbbd928bd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085109 Jul 18 17:13:20.204112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 690/1489] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:20 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:21.220829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0b65b67e-040e-413e-afd7-698a6e3f6dd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:21.221476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0b65b67e-040e-413e-afd7-698a6e3f6dd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:21.228000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b65b67e-040e-413e-afd7-698a6e3f6dd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:21.228468 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b65b67e-040e-413e-afd7-698a6e3f6dd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:21.229216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b65b67e-040e-413e-afd7-698a6e3f6dd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:21.229657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b65b67e-040e-413e-afd7-698a6e3f6dd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:21.294944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0b65b67e-040e-413e-afd7-698a6e3f6dd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:21.303133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0b65b67e-040e-413e-afd7-698a6e3f6dd9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086229 Jul 18 17:13:21.303729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 691/1490] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:22.321039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9e53568c-f90c-4457-b8bb-aa6dbea90a27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:22.321709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9e53568c-f90c-4457-b8bb-aa6dbea90a27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:22.328746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e53568c-f90c-4457-b8bb-aa6dbea90a27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:22.329187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e53568c-f90c-4457-b8bb-aa6dbea90a27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:22.329933 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e53568c-f90c-4457-b8bb-aa6dbea90a27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:22.330366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e53568c-f90c-4457-b8bb-aa6dbea90a27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:22.391902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9e53568c-f90c-4457-b8bb-aa6dbea90a27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:22.400039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9e53568c-f90c-4457-b8bb-aa6dbea90a27 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082805 Jul 18 17:13:22.400564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 692/1491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:23.418979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c8a0e61d-f46b-4c85-bc4e-19abc2e36a86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:23.420022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c8a0e61d-f46b-4c85-bc4e-19abc2e36a86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:23.426904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8a0e61d-f46b-4c85-bc4e-19abc2e36a86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:23.427355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8a0e61d-f46b-4c85-bc4e-19abc2e36a86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:23.428168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8a0e61d-f46b-4c85-bc4e-19abc2e36a86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:23.428857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8a0e61d-f46b-4c85-bc4e-19abc2e36a86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:23.493790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c8a0e61d-f46b-4c85-bc4e-19abc2e36a86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:23.501968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c8a0e61d-f46b-4c85-bc4e-19abc2e36a86 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088065 Jul 18 17:13:23.502530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 693/1492] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:23 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:24.518402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a47d6ebb-90b4-48c2-b16f-b5b2c3c36f75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:24.519095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a47d6ebb-90b4-48c2-b16f-b5b2c3c36f75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:24.525535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a47d6ebb-90b4-48c2-b16f-b5b2c3c36f75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:24.525979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a47d6ebb-90b4-48c2-b16f-b5b2c3c36f75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:24.526807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a47d6ebb-90b4-48c2-b16f-b5b2c3c36f75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:24.527244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a47d6ebb-90b4-48c2-b16f-b5b2c3c36f75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:24.541632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:13:24.588871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a47d6ebb-90b4-48c2-b16f-b5b2c3c36f75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:24.597070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a47d6ebb-90b4-48c2-b16f-b5b2c3c36f75 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082670 Jul 18 17:13:24.597652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 694/1493] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:25.614205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c828d096-1a73-4645-b6f9-64f037ebe233 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:25.614868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c828d096-1a73-4645-b6f9-64f037ebe233 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:25.621975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c828d096-1a73-4645-b6f9-64f037ebe233 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:25.622419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c828d096-1a73-4645-b6f9-64f037ebe233 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:25.623184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c828d096-1a73-4645-b6f9-64f037ebe233 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:25.623628 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c828d096-1a73-4645-b6f9-64f037ebe233 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:25.691482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c828d096-1a73-4645-b6f9-64f037ebe233 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:25.700738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c828d096-1a73-4645-b6f9-64f037ebe233 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.090339 Jul 18 17:13:25.701309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 695/1494] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:26.717780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9180393f-811d-488a-9c0b-3222cd7df2cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:26.718435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9180393f-811d-488a-9c0b-3222cd7df2cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:26.725056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9180393f-811d-488a-9c0b-3222cd7df2cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:26.725508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9180393f-811d-488a-9c0b-3222cd7df2cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:26.726277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9180393f-811d-488a-9c0b-3222cd7df2cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:26.726710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9180393f-811d-488a-9c0b-3222cd7df2cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:26.787095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9180393f-811d-488a-9c0b-3222cd7df2cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:26.795822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9180393f-811d-488a-9c0b-3222cd7df2cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081954 Jul 18 17:13:26.796387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 696/1495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:27.813359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-045010cb-0489-4440-b0df-cb240e7d0c14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:27.814054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-045010cb-0489-4440-b0df-cb240e7d0c14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:27.820526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-045010cb-0489-4440-b0df-cb240e7d0c14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:27.820977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-045010cb-0489-4440-b0df-cb240e7d0c14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:27.821739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-045010cb-0489-4440-b0df-cb240e7d0c14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:27.822175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-045010cb-0489-4440-b0df-cb240e7d0c14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:27.884150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-045010cb-0489-4440-b0df-cb240e7d0c14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:27.892194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-045010cb-0489-4440-b0df-cb240e7d0c14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082624 Jul 18 17:13:27.892763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 697/1496] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:28.910071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d757a60c-0e6a-4c0c-bab7-d8d97a887681 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:28.910703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d757a60c-0e6a-4c0c-bab7-d8d97a887681 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:28.918554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d757a60c-0e6a-4c0c-bab7-d8d97a887681 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:28.919021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d757a60c-0e6a-4c0c-bab7-d8d97a887681 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:28.919819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d757a60c-0e6a-4c0c-bab7-d8d97a887681 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:28.920257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d757a60c-0e6a-4c0c-bab7-d8d97a887681 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:28.983330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d757a60c-0e6a-4c0c-bab7-d8d97a887681 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:28.991382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d757a60c-0e6a-4c0c-bab7-d8d97a887681 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085316 Jul 18 17:13:28.991972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 698/1497] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:28 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:30.009303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-19128b01-d317-4ed0-ad7f-7c949e1cf08c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:30.010020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-19128b01-d317-4ed0-ad7f-7c949e1cf08c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:30.017343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19128b01-d317-4ed0-ad7f-7c949e1cf08c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:30.017787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19128b01-d317-4ed0-ad7f-7c949e1cf08c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:30.018546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19128b01-d317-4ed0-ad7f-7c949e1cf08c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:30.018974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19128b01-d317-4ed0-ad7f-7c949e1cf08c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:30.093353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-19128b01-d317-4ed0-ad7f-7c949e1cf08c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:30.102581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-19128b01-d317-4ed0-ad7f-7c949e1cf08c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.097119 Jul 18 17:13:30.103160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 699/1498] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:31.120297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a788c344-e0b3-4c9e-9a15-00c4a6452af0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:31.120938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a788c344-e0b3-4c9e-9a15-00c4a6452af0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:31.127463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a788c344-e0b3-4c9e-9a15-00c4a6452af0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:31.127947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a788c344-e0b3-4c9e-9a15-00c4a6452af0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:31.128711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a788c344-e0b3-4c9e-9a15-00c4a6452af0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:31.129148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a788c344-e0b3-4c9e-9a15-00c4a6452af0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:31.247999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a788c344-e0b3-4c9e-9a15-00c4a6452af0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:31.256453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a788c344-e0b3-4c9e-9a15-00c4a6452af0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.140115 Jul 18 17:13:31.257053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 700/1499] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:32.274357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-619df2ca-3b9c-40f6-b46e-f654f0d6e9bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:32.275031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-619df2ca-3b9c-40f6-b46e-f654f0d6e9bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:32.282013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-619df2ca-3b9c-40f6-b46e-f654f0d6e9bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:32.282466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-619df2ca-3b9c-40f6-b46e-f654f0d6e9bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:32.283229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-619df2ca-3b9c-40f6-b46e-f654f0d6e9bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:32.283697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-619df2ca-3b9c-40f6-b46e-f654f0d6e9bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:32.348193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-619df2ca-3b9c-40f6-b46e-f654f0d6e9bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:32.356886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-619df2ca-3b9c-40f6-b46e-f654f0d6e9bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086417 Jul 18 17:13:32.357460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 701/1500] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:33.373954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f9c54396-b4b2-40f6-8621-5826446da09b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:33.374636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f9c54396-b4b2-40f6-8621-5826446da09b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:33.381070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f9c54396-b4b2-40f6-8621-5826446da09b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:33.381522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f9c54396-b4b2-40f6-8621-5826446da09b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:33.382282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f9c54396-b4b2-40f6-8621-5826446da09b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:33.382724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f9c54396-b4b2-40f6-8621-5826446da09b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:33.443313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f9c54396-b4b2-40f6-8621-5826446da09b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:33.452922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f9c54396-b4b2-40f6-8621-5826446da09b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082859 Jul 18 17:13:33.453483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 702/1501] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:33 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:34.469125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d9ac710f-154a-4940-a098-4a8318f2383a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:34.469798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d9ac710f-154a-4940-a098-4a8318f2383a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:34.476239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9ac710f-154a-4940-a098-4a8318f2383a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:34.476687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9ac710f-154a-4940-a098-4a8318f2383a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:34.477439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9ac710f-154a-4940-a098-4a8318f2383a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:34.477867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d9ac710f-154a-4940-a098-4a8318f2383a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:34.556152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d9ac710f-154a-4940-a098-4a8318f2383a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:34.591537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d9ac710f-154a-4940-a098-4a8318f2383a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.126325 Jul 18 17:13:34.595370 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 703/1502] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:34 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:35.609237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f6c325e4-9421-41d2-98e4-2e8472801967 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:35.609938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f6c325e4-9421-41d2-98e4-2e8472801967 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:35.616479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f6c325e4-9421-41d2-98e4-2e8472801967 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:35.616929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f6c325e4-9421-41d2-98e4-2e8472801967 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:35.617696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f6c325e4-9421-41d2-98e4-2e8472801967 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:35.618133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f6c325e4-9421-41d2-98e4-2e8472801967 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:35.680251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f6c325e4-9421-41d2-98e4-2e8472801967 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:35.688386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f6c325e4-9421-41d2-98e4-2e8472801967 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083246 Jul 18 17:13:35.692798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 704/1503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:36.705682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f737bb8e-4f72-4221-ac5a-95d03fd94404 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:36.706397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f737bb8e-4f72-4221-ac5a-95d03fd94404 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:36.712831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f737bb8e-4f72-4221-ac5a-95d03fd94404 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:36.713280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f737bb8e-4f72-4221-ac5a-95d03fd94404 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:36.714043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f737bb8e-4f72-4221-ac5a-95d03fd94404 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:36.714692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f737bb8e-4f72-4221-ac5a-95d03fd94404 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:36.774672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f737bb8e-4f72-4221-ac5a-95d03fd94404 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:36.783339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f737bb8e-4f72-4221-ac5a-95d03fd94404 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081562 Jul 18 17:13:36.783931 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 705/1504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:36 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:37.801138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-964452b4-c0ce-4f6f-beb7-1027bb0289a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:37.801788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-964452b4-c0ce-4f6f-beb7-1027bb0289a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:37.804060 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=56 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:13:37.809615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-964452b4-c0ce-4f6f-beb7-1027bb0289a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:37.810068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-964452b4-c0ce-4f6f-beb7-1027bb0289a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:37.810827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-964452b4-c0ce-4f6f-beb7-1027bb0289a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:37.811266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-964452b4-c0ce-4f6f-beb7-1027bb0289a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:37.873611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-964452b4-c0ce-4f6f-beb7-1027bb0289a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:37.881578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-964452b4-c0ce-4f6f-beb7-1027bb0289a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084532 Jul 18 17:13:37.882137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 706/1505] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:37 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:38.899638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-459dbc8e-e37b-456d-8215-90e047196323 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:38.900373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-459dbc8e-e37b-456d-8215-90e047196323 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:38.907650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-459dbc8e-e37b-456d-8215-90e047196323 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:38.908099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-459dbc8e-e37b-456d-8215-90e047196323 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:38.908854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-459dbc8e-e37b-456d-8215-90e047196323 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:38.909288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-459dbc8e-e37b-456d-8215-90e047196323 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:38.972766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-459dbc8e-e37b-456d-8215-90e047196323 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:38.980911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-459dbc8e-e37b-456d-8215-90e047196323 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085171 Jul 18 17:13:38.981480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 707/1506] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:38 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:39.998652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e2ba0675-eeb3-49f0-9f94-a91143b11b39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:39.999512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e2ba0675-eeb3-49f0-9f94-a91143b11b39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:40.006600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e2ba0675-eeb3-49f0-9f94-a91143b11b39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:40.007056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e2ba0675-eeb3-49f0-9f94-a91143b11b39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:40.007851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e2ba0675-eeb3-49f0-9f94-a91143b11b39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:40.008293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e2ba0675-eeb3-49f0-9f94-a91143b11b39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:40.073238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e2ba0675-eeb3-49f0-9f94-a91143b11b39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:40.081835 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e2ba0675-eeb3-49f0-9f94-a91143b11b39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088126 Jul 18 17:13:40.082402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 708/1507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:39 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:41.098745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5140ef77-aa6c-4806-9d4b-13dd764cef6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:41.099416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5140ef77-aa6c-4806-9d4b-13dd764cef6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:41.106361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5140ef77-aa6c-4806-9d4b-13dd764cef6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:41.106805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5140ef77-aa6c-4806-9d4b-13dd764cef6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:41.107606 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5140ef77-aa6c-4806-9d4b-13dd764cef6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:41.108071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5140ef77-aa6c-4806-9d4b-13dd764cef6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:41.174357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5140ef77-aa6c-4806-9d4b-13dd764cef6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:41.182626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5140ef77-aa6c-4806-9d4b-13dd764cef6a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088006 Jul 18 17:13:41.183766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 709/1508] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:41 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:42.201586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0bdcca15-8bbe-4cca-931b-907fde2ffe85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:42.202258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0bdcca15-8bbe-4cca-931b-907fde2ffe85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:42.209049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0bdcca15-8bbe-4cca-931b-907fde2ffe85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:42.209480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0bdcca15-8bbe-4cca-931b-907fde2ffe85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:42.210239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0bdcca15-8bbe-4cca-931b-907fde2ffe85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:42.210684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0bdcca15-8bbe-4cca-931b-907fde2ffe85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:42.273390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0bdcca15-8bbe-4cca-931b-907fde2ffe85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:42.281665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0bdcca15-8bbe-4cca-931b-907fde2ffe85 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084600 Jul 18 17:13:42.282236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 710/1509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:42 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:43.298505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-be269cb2-7a37-497f-b0f6-d2de73ae6c37 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:43.299172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-be269cb2-7a37-497f-b0f6-d2de73ae6c37 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:43.305705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-be269cb2-7a37-497f-b0f6-d2de73ae6c37 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:43.306151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-be269cb2-7a37-497f-b0f6-d2de73ae6c37 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:43.306970 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-be269cb2-7a37-497f-b0f6-d2de73ae6c37 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:43.307345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-be269cb2-7a37-497f-b0f6-d2de73ae6c37 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:43.310165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:13:43.373571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-be269cb2-7a37-497f-b0f6-d2de73ae6c37 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:43.381498 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-be269cb2-7a37-497f-b0f6-d2de73ae6c37 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087109 Jul 18 17:13:43.382080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 711/1510] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:43 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:44.399367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1eecd57f-1bb7-4562-86cf-c94a36a1869a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:44.400161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1eecd57f-1bb7-4562-86cf-c94a36a1869a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:44.406797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1eecd57f-1bb7-4562-86cf-c94a36a1869a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:44.407187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1eecd57f-1bb7-4562-86cf-c94a36a1869a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:44.407982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1eecd57f-1bb7-4562-86cf-c94a36a1869a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:44.408427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1eecd57f-1bb7-4562-86cf-c94a36a1869a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:44.471006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1eecd57f-1bb7-4562-86cf-c94a36a1869a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:44.479331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1eecd57f-1bb7-4562-86cf-c94a36a1869a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083758 Jul 18 17:13:44.480149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 712/1511] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:44 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:45.496510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5f98853d-63b0-4d1e-a3e3-c1a7fc70e5d6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:45.497278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5f98853d-63b0-4d1e-a3e3-c1a7fc70e5d6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:45.503641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5f98853d-63b0-4d1e-a3e3-c1a7fc70e5d6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:45.504089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5f98853d-63b0-4d1e-a3e3-c1a7fc70e5d6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:45.504850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5f98853d-63b0-4d1e-a3e3-c1a7fc70e5d6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:45.505287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5f98853d-63b0-4d1e-a3e3-c1a7fc70e5d6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:45.566210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5f98853d-63b0-4d1e-a3e3-c1a7fc70e5d6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:45.574176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5f98853d-63b0-4d1e-a3e3-c1a7fc70e5d6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081585 Jul 18 17:13:45.575243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 713/1512] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:45 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:45.877684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:13:45.877886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:13:46.592469 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a013e3f5-201c-43f2-b87a-eb4d04b5bfa2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:46.598427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a013e3f5-201c-43f2-b87a-eb4d04b5bfa2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:46.599538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a013e3f5-201c-43f2-b87a-eb4d04b5bfa2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:46.599993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a013e3f5-201c-43f2-b87a-eb4d04b5bfa2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:46.600755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a013e3f5-201c-43f2-b87a-eb4d04b5bfa2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:46.601198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a013e3f5-201c-43f2-b87a-eb4d04b5bfa2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:46.664421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a013e3f5-201c-43f2-b87a-eb4d04b5bfa2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:46.673411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a013e3f5-201c-43f2-b87a-eb4d04b5bfa2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085545 Jul 18 17:13:46.674001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 714/1513] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:46 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:46.678338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5ff8f66b-9800-40fd-b8a1-a4537e1f3214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:46.678936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5ff8f66b-9800-40fd-b8a1-a4537e1f3214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:46.684774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5ff8f66b-9800-40fd-b8a1-a4537e1f3214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:46.685221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5ff8f66b-9800-40fd-b8a1-a4537e1f3214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:46.685979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5ff8f66b-9800-40fd-b8a1-a4537e1f3214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:46.686417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5ff8f66b-9800-40fd-b8a1-a4537e1f3214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:46.752577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5ff8f66b-9800-40fd-b8a1-a4537e1f3214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:46.760579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5ff8f66b-9800-40fd-b8a1-a4537e1f3214 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.085665 Jul 18 17:13:46.761140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 715/1514] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:46 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:47.691053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c9b9e7d6-7d24-4f36-9ca7-a36b2cc1db8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:47.691766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c9b9e7d6-7d24-4f36-9ca7-a36b2cc1db8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:47.698278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9b9e7d6-7d24-4f36-9ca7-a36b2cc1db8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:47.698728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9b9e7d6-7d24-4f36-9ca7-a36b2cc1db8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:47.699485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9b9e7d6-7d24-4f36-9ca7-a36b2cc1db8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:47.699961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9b9e7d6-7d24-4f36-9ca7-a36b2cc1db8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:47.994658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c9b9e7d6-7d24-4f36-9ca7-a36b2cc1db8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:48.003351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c9b9e7d6-7d24-4f36-9ca7-a36b2cc1db8a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.316079 Jul 18 17:13:48.003940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 716/1515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:47 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:48.008331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-67332d00-b6fe-49c0-9cc1-2b2e626bec0c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:48.008918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-67332d00-b6fe-49c0-9cc1-2b2e626bec0c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:48.015222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67332d00-b6fe-49c0-9cc1-2b2e626bec0c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:48.015719 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67332d00-b6fe-49c0-9cc1-2b2e626bec0c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:48.016479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67332d00-b6fe-49c0-9cc1-2b2e626bec0c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:48.016887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67332d00-b6fe-49c0-9cc1-2b2e626bec0c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:48.077811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-67332d00-b6fe-49c0-9cc1-2b2e626bec0c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:48.085798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-67332d00-b6fe-49c0-9cc1-2b2e626bec0c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.080920 Jul 18 17:13:48.086364 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 717/1516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:48 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:49.020419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-16e99ef4-0b69-4a79-89e7-185f7d6926ba tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:49.021113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-16e99ef4-0b69-4a79-89e7-185f7d6926ba tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:49.027538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-16e99ef4-0b69-4a79-89e7-185f7d6926ba tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:49.028022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-16e99ef4-0b69-4a79-89e7-185f7d6926ba tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:49.028784 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-16e99ef4-0b69-4a79-89e7-185f7d6926ba tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:49.029222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-16e99ef4-0b69-4a79-89e7-185f7d6926ba tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:49.090735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-16e99ef4-0b69-4a79-89e7-185f7d6926ba tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:49.098919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-16e99ef4-0b69-4a79-89e7-185f7d6926ba tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082345 Jul 18 17:13:49.099515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 718/1517] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:49 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:49.103973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-690ab8c8-b2f8-4b82-9cf7-c6d4d5ce4360 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:49.104641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-690ab8c8-b2f8-4b82-9cf7-c6d4d5ce4360 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:49.110899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-690ab8c8-b2f8-4b82-9cf7-c6d4d5ce4360 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:49.111348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-690ab8c8-b2f8-4b82-9cf7-c6d4d5ce4360 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:49.112137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-690ab8c8-b2f8-4b82-9cf7-c6d4d5ce4360 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:49.112603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-690ab8c8-b2f8-4b82-9cf7-c6d4d5ce4360 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:49.173283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-690ab8c8-b2f8-4b82-9cf7-c6d4d5ce4360 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:49.181118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-690ab8c8-b2f8-4b82-9cf7-c6d4d5ce4360 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.080681 Jul 18 17:13:49.181673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 719/1518] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:49 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:50.116620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-59839363-20e6-431f-bb38-26a17abefbf0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:50.117280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-59839363-20e6-431f-bb38-26a17abefbf0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:50.123918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59839363-20e6-431f-bb38-26a17abefbf0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:50.124373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59839363-20e6-431f-bb38-26a17abefbf0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:50.125138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59839363-20e6-431f-bb38-26a17abefbf0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:50.125571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59839363-20e6-431f-bb38-26a17abefbf0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:50.192296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59839363-20e6-431f-bb38-26a17abefbf0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:50.201035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-59839363-20e6-431f-bb38-26a17abefbf0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087668 Jul 18 17:13:50.201704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 720/1519] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:50 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:50.206201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-da7e458a-eef5-4592-b7fc-c8f1422e9a2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:50.206790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-da7e458a-eef5-4592-b7fc-c8f1422e9a2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:50.212858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da7e458a-eef5-4592-b7fc-c8f1422e9a2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:50.213299 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da7e458a-eef5-4592-b7fc-c8f1422e9a2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:50.214048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da7e458a-eef5-4592-b7fc-c8f1422e9a2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:50.214478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da7e458a-eef5-4592-b7fc-c8f1422e9a2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:50.276936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-da7e458a-eef5-4592-b7fc-c8f1422e9a2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:50.284990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-da7e458a-eef5-4592-b7fc-c8f1422e9a2a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082321 Jul 18 17:13:50.285558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 721/1520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:50 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:51.218412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d08a244a-e2d2-4896-aa7f-16931b299604 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:51.219058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d08a244a-e2d2-4896-aa7f-16931b299604 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:51.225480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d08a244a-e2d2-4896-aa7f-16931b299604 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:51.225921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d08a244a-e2d2-4896-aa7f-16931b299604 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:51.226675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d08a244a-e2d2-4896-aa7f-16931b299604 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:51.227104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d08a244a-e2d2-4896-aa7f-16931b299604 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:51.289311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d08a244a-e2d2-4896-aa7f-16931b299604 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:51.297819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d08a244a-e2d2-4896-aa7f-16931b299604 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083575 Jul 18 17:13:51.298381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 722/1521] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:51 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:51.302694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-41ffcb97-8b2c-4072-b02a-7fb41acb4b28 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:51.303387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-41ffcb97-8b2c-4072-b02a-7fb41acb4b28 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:51.309090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41ffcb97-8b2c-4072-b02a-7fb41acb4b28 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:51.309530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41ffcb97-8b2c-4072-b02a-7fb41acb4b28 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:51.310810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41ffcb97-8b2c-4072-b02a-7fb41acb4b28 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:51.311264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41ffcb97-8b2c-4072-b02a-7fb41acb4b28 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:51.373527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-41ffcb97-8b2c-4072-b02a-7fb41acb4b28 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:51.381343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-41ffcb97-8b2c-4072-b02a-7fb41acb4b28 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082034 Jul 18 17:13:51.381969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 723/1522] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:51 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:52.314607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-221a2c42-c047-4e3e-b48f-8ed20ee217fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:52.315330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-221a2c42-c047-4e3e-b48f-8ed20ee217fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:52.321817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-221a2c42-c047-4e3e-b48f-8ed20ee217fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:52.322266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-221a2c42-c047-4e3e-b48f-8ed20ee217fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:52.323034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-221a2c42-c047-4e3e-b48f-8ed20ee217fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:52.323470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-221a2c42-c047-4e3e-b48f-8ed20ee217fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:52.387195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-221a2c42-c047-4e3e-b48f-8ed20ee217fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:52.396354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-221a2c42-c047-4e3e-b48f-8ed20ee217fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085717 Jul 18 17:13:52.396905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 724/1523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:52 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:52.401189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d8ed2181-6bb5-403d-b7d4-e81e13ff1b3d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:52.401771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d8ed2181-6bb5-403d-b7d4-e81e13ff1b3d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:52.408728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8ed2181-6bb5-403d-b7d4-e81e13ff1b3d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:52.409101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8ed2181-6bb5-403d-b7d4-e81e13ff1b3d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:52.409855 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8ed2181-6bb5-403d-b7d4-e81e13ff1b3d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:52.410279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d8ed2181-6bb5-403d-b7d4-e81e13ff1b3d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:52.471505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d8ed2181-6bb5-403d-b7d4-e81e13ff1b3d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:52.479324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d8ed2181-6bb5-403d-b7d4-e81e13ff1b3d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.081501 Jul 18 17:13:52.479903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 725/1524] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:52 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:53.414234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-76ad493f-cdf0-4c21-a5d0-490a2d677182 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:53.414913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-76ad493f-cdf0-4c21-a5d0-490a2d677182 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:53.422555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-76ad493f-cdf0-4c21-a5d0-490a2d677182 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:53.422989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-76ad493f-cdf0-4c21-a5d0-490a2d677182 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:53.423778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-76ad493f-cdf0-4c21-a5d0-490a2d677182 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:53.424207 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-76ad493f-cdf0-4c21-a5d0-490a2d677182 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:53.484842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-76ad493f-cdf0-4c21-a5d0-490a2d677182 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:53.493647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-76ad493f-cdf0-4c21-a5d0-490a2d677182 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083369 Jul 18 17:13:53.494219 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 726/1525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:53 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:53.498942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-89274947-0847-463a-907c-92b5c58f56a5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:53.499572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-89274947-0847-463a-907c-92b5c58f56a5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:53.505527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-89274947-0847-463a-907c-92b5c58f56a5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:53.505979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-89274947-0847-463a-907c-92b5c58f56a5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:53.506736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-89274947-0847-463a-907c-92b5c58f56a5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:53.507172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-89274947-0847-463a-907c-92b5c58f56a5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:53.568148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-89274947-0847-463a-907c-92b5c58f56a5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:53.570304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:13:53.577106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-89274947-0847-463a-907c-92b5c58f56a5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.081922 Jul 18 17:13:53.582071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 727/1526] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:53 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:54.510203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-40087af9-4a58-4c3e-985b-656bb2e17c15 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:54.510871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-40087af9-4a58-4c3e-985b-656bb2e17c15 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:54.518153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40087af9-4a58-4c3e-985b-656bb2e17c15 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:54.518603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40087af9-4a58-4c3e-985b-656bb2e17c15 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:54.519362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40087af9-4a58-4c3e-985b-656bb2e17c15 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:54.519828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40087af9-4a58-4c3e-985b-656bb2e17c15 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:54.583555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-40087af9-4a58-4c3e-985b-656bb2e17c15 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:54.591880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-40087af9-4a58-4c3e-985b-656bb2e17c15 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085455 Jul 18 17:13:54.592445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 728/1527] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:54 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:54.596937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4e5e6c70-7e62-41a4-8e94-a09cc7286f73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:54.597534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4e5e6c70-7e62-41a4-8e94-a09cc7286f73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:54.603352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e5e6c70-7e62-41a4-8e94-a09cc7286f73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:54.603843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e5e6c70-7e62-41a4-8e94-a09cc7286f73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:54.604606 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e5e6c70-7e62-41a4-8e94-a09cc7286f73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:54.605043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e5e6c70-7e62-41a4-8e94-a09cc7286f73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:54.665957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4e5e6c70-7e62-41a4-8e94-a09cc7286f73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:54.675030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4e5e6c70-7e62-41a4-8e94-a09cc7286f73 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.081633 Jul 18 17:13:54.675625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 729/1528] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:54 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:55.608965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e01623be-2562-429f-b89f-24d13e456c54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:55.609624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e01623be-2562-429f-b89f-24d13e456c54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:55.616137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e01623be-2562-429f-b89f-24d13e456c54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:55.616580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e01623be-2562-429f-b89f-24d13e456c54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:55.617334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e01623be-2562-429f-b89f-24d13e456c54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:55.617768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e01623be-2562-429f-b89f-24d13e456c54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:55.679270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e01623be-2562-429f-b89f-24d13e456c54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:55.687437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e01623be-2562-429f-b89f-24d13e456c54 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082949 Jul 18 17:13:55.688033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 730/1529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:55 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:55.692544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-86f52393-f01f-4e38-8b74-6ac78e78d0bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:55.693122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-86f52393-f01f-4e38-8b74-6ac78e78d0bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:55.698844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-86f52393-f01f-4e38-8b74-6ac78e78d0bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:55.699291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-86f52393-f01f-4e38-8b74-6ac78e78d0bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:55.700085 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-86f52393-f01f-4e38-8b74-6ac78e78d0bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:55.700650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-86f52393-f01f-4e38-8b74-6ac78e78d0bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:55.760292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-86f52393-f01f-4e38-8b74-6ac78e78d0bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:55.768929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-86f52393-f01f-4e38-8b74-6ac78e78d0bd tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.079908 Jul 18 17:13:55.769495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 731/1530] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:55 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:56.704948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c0761b47-e518-4892-9db2-1e62733f177e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:56.705641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c0761b47-e518-4892-9db2-1e62733f177e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:56.712126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c0761b47-e518-4892-9db2-1e62733f177e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:56.712575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c0761b47-e518-4892-9db2-1e62733f177e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:56.713332 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c0761b47-e518-4892-9db2-1e62733f177e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:56.713768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c0761b47-e518-4892-9db2-1e62733f177e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:56.779470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c0761b47-e518-4892-9db2-1e62733f177e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:56.787403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c0761b47-e518-4892-9db2-1e62733f177e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086314 Jul 18 17:13:56.787985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 732/1531] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:56 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:56.792279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-18b5b29f-6153-411c-af80-a1128019ee26 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:56.792862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-18b5b29f-6153-411c-af80-a1128019ee26 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:56.798835 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18b5b29f-6153-411c-af80-a1128019ee26 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:56.799272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18b5b29f-6153-411c-af80-a1128019ee26 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:56.800047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18b5b29f-6153-411c-af80-a1128019ee26 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:56.800502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18b5b29f-6153-411c-af80-a1128019ee26 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:56.861309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-18b5b29f-6153-411c-af80-a1128019ee26 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:56.869314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-18b5b29f-6153-411c-af80-a1128019ee26 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.080400 Jul 18 17:13:56.869873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 733/1532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:56 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:57.803991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2d0a1c35-0e9d-467c-a4a2-3179c18f2f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:57.804690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2d0a1c35-0e9d-467c-a4a2-3179c18f2f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:57.811294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2d0a1c35-0e9d-467c-a4a2-3179c18f2f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:57.811777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2d0a1c35-0e9d-467c-a4a2-3179c18f2f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:57.812541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2d0a1c35-0e9d-467c-a4a2-3179c18f2f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:57.812975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2d0a1c35-0e9d-467c-a4a2-3179c18f2f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:57.875025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2d0a1c35-0e9d-467c-a4a2-3179c18f2f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:57.882994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2d0a1c35-0e9d-467c-a4a2-3179c18f2f28 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082894 Jul 18 17:13:57.883572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 734/1533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:57 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:57.887909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-325fae2b-25f4-4db4-8233-0af6ca2ab88a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:57.888511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-325fae2b-25f4-4db4-8233-0af6ca2ab88a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:57.894446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-325fae2b-25f4-4db4-8233-0af6ca2ab88a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:57.894889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-325fae2b-25f4-4db4-8233-0af6ca2ab88a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:57.895676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-325fae2b-25f4-4db4-8233-0af6ca2ab88a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:57.896113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-325fae2b-25f4-4db4-8233-0af6ca2ab88a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:57.957592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-325fae2b-25f4-4db4-8233-0af6ca2ab88a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:57.965568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-325fae2b-25f4-4db4-8233-0af6ca2ab88a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.081052 Jul 18 17:13:57.966661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 735/1534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:57 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:13:58.900296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c8e397bf-acb8-4cc1-9b75-961e948cfb14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:58.900948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c8e397bf-acb8-4cc1-9b75-961e948cfb14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:58.908290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8e397bf-acb8-4cc1-9b75-961e948cfb14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:58.908737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8e397bf-acb8-4cc1-9b75-961e948cfb14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:58.909477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8e397bf-acb8-4cc1-9b75-961e948cfb14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:58.909906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8e397bf-acb8-4cc1-9b75-961e948cfb14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:58.975043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c8e397bf-acb8-4cc1-9b75-961e948cfb14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:58.983682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c8e397bf-acb8-4cc1-9b75-961e948cfb14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087232 Jul 18 17:13:58.984241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 736/1535] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:58 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:13:58.988641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-08ae2bf7-bcbd-49f4-8058-1e0324c8a0df tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:13:58.989235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-08ae2bf7-bcbd-49f4-8058-1e0324c8a0df tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:13:58.994987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08ae2bf7-bcbd-49f4-8058-1e0324c8a0df tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:58.995430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08ae2bf7-bcbd-49f4-8058-1e0324c8a0df tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:58.996212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08ae2bf7-bcbd-49f4-8058-1e0324c8a0df tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:13:58.996651 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-08ae2bf7-bcbd-49f4-8058-1e0324c8a0df tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:13:59.057549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-08ae2bf7-bcbd-49f4-8058-1e0324c8a0df tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:13:59.065559 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-08ae2bf7-bcbd-49f4-8058-1e0324c8a0df tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.080380 Jul 18 17:13:59.066118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 737/1536] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:58 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:00.001431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ea3157df-f504-45a9-9307-f9c246af33b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:00.002102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ea3157df-f504-45a9-9307-f9c246af33b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:00.008546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea3157df-f504-45a9-9307-f9c246af33b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:00.008995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea3157df-f504-45a9-9307-f9c246af33b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:00.009767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea3157df-f504-45a9-9307-f9c246af33b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:00.010203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea3157df-f504-45a9-9307-f9c246af33b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:00.072874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea3157df-f504-45a9-9307-f9c246af33b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:00.082090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ea3157df-f504-45a9-9307-f9c246af33b0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085294 Jul 18 17:14:00.082652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 738/1537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:13:59 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:00.087019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1b809e52-e780-4a88-b5b4-37021a9ac3cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:00.087551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1b809e52-e780-4a88-b5b4-37021a9ac3cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:00.094031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b809e52-e780-4a88-b5b4-37021a9ac3cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:00.094472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b809e52-e780-4a88-b5b4-37021a9ac3cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:00.095222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b809e52-e780-4a88-b5b4-37021a9ac3cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:00.095688 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1b809e52-e780-4a88-b5b4-37021a9ac3cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:00.158087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1b809e52-e780-4a88-b5b4-37021a9ac3cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:00.166177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1b809e52-e780-4a88-b5b4-37021a9ac3cf tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082562 Jul 18 17:14:00.166848 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 739/1538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:00 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:01.098936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-62921a86-aa35-4051-a387-3ace9b6ca2f8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:01.099722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-62921a86-aa35-4051-a387-3ace9b6ca2f8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:01.106152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-62921a86-aa35-4051-a387-3ace9b6ca2f8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:01.106562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-62921a86-aa35-4051-a387-3ace9b6ca2f8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:01.107321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-62921a86-aa35-4051-a387-3ace9b6ca2f8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:01.107782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-62921a86-aa35-4051-a387-3ace9b6ca2f8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:01.174745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-62921a86-aa35-4051-a387-3ace9b6ca2f8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:01.182883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-62921a86-aa35-4051-a387-3ace9b6ca2f8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087816 Jul 18 17:14:01.183451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 740/1539] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:01 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:01.241949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-33f946f6-6199-49d7-bf55-4588fbce17ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:01.242549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-33f946f6-6199-49d7-bf55-4588fbce17ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:01.253006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33f946f6-6199-49d7-bf55-4588fbce17ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:01.253459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33f946f6-6199-49d7-bf55-4588fbce17ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:01.254690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33f946f6-6199-49d7-bf55-4588fbce17ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:01.255134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33f946f6-6199-49d7-bf55-4588fbce17ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:01.470503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-33f946f6-6199-49d7-bf55-4588fbce17ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:01.478302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-33f946f6-6199-49d7-bf55-4588fbce17ab tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.240230 Jul 18 17:14:01.478852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 741/1540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:01 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:02.199346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bccef6be-a1c5-4f1c-9c31-1cd54cbfdcfb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:02.200599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bccef6be-a1c5-4f1c-9c31-1cd54cbfdcfb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:02.207245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bccef6be-a1c5-4f1c-9c31-1cd54cbfdcfb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:02.207737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bccef6be-a1c5-4f1c-9c31-1cd54cbfdcfb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:02.208505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bccef6be-a1c5-4f1c-9c31-1cd54cbfdcfb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:02.208963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bccef6be-a1c5-4f1c-9c31-1cd54cbfdcfb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:02.271127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bccef6be-a1c5-4f1c-9c31-1cd54cbfdcfb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:02.279122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bccef6be-a1c5-4f1c-9c31-1cd54cbfdcfb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083892 Jul 18 17:14:02.279715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 742/1541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:02 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:02.494954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e75d5845-df56-4a64-87da-85e4fc077068 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:02.495577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e75d5845-df56-4a64-87da-85e4fc077068 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:02.502237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e75d5845-df56-4a64-87da-85e4fc077068 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:02.502678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e75d5845-df56-4a64-87da-85e4fc077068 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:02.503434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e75d5845-df56-4a64-87da-85e4fc077068 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:02.503892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e75d5845-df56-4a64-87da-85e4fc077068 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:02.566300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e75d5845-df56-4a64-87da-85e4fc077068 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:02.574275 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e75d5845-df56-4a64-87da-85e4fc077068 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.083163 Jul 18 17:14:02.574821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 743/1542] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:02 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:03.296958 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8f400385-f207-46fd-b4ba-e4814070c05f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:03.299367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8f400385-f207-46fd-b4ba-e4814070c05f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:03.304377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8f400385-f207-46fd-b4ba-e4814070c05f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:03.304823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8f400385-f207-46fd-b4ba-e4814070c05f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:03.305591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8f400385-f207-46fd-b4ba-e4814070c05f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:03.306029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8f400385-f207-46fd-b4ba-e4814070c05f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:03.321930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:14:03.371397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8f400385-f207-46fd-b4ba-e4814070c05f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:03.379988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8f400385-f207-46fd-b4ba-e4814070c05f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087917 Jul 18 17:14:03.380537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 744/1543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:03 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:03.592315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-114df145-d50d-4a54-ab63-e404c75747b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:03.592913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-114df145-d50d-4a54-ab63-e404c75747b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:03.598958 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-114df145-d50d-4a54-ab63-e404c75747b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:03.599402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-114df145-d50d-4a54-ab63-e404c75747b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:03.600181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-114df145-d50d-4a54-ab63-e404c75747b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:03.600612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-114df145-d50d-4a54-ab63-e404c75747b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:03.664119 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-114df145-d50d-4a54-ab63-e404c75747b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:03.673376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-114df145-d50d-4a54-ab63-e404c75747b9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.085549 Jul 18 17:14:03.674051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 745/1544] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:03 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:04.397279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-65fc79ea-56bb-4649-8562-31f47d6b42ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:04.397904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-65fc79ea-56bb-4649-8562-31f47d6b42ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:04.404624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65fc79ea-56bb-4649-8562-31f47d6b42ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:04.405067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65fc79ea-56bb-4649-8562-31f47d6b42ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:04.405825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65fc79ea-56bb-4649-8562-31f47d6b42ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:04.406261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65fc79ea-56bb-4649-8562-31f47d6b42ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:04.467896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-65fc79ea-56bb-4649-8562-31f47d6b42ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:04.476015 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-65fc79ea-56bb-4649-8562-31f47d6b42ff tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082901 Jul 18 17:14:04.476577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 746/1545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:04 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:04.691157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0a6c838f-e211-4953-bd1e-8161a3b6f5fc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:04.691686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0a6c838f-e211-4953-bd1e-8161a3b6f5fc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:04.697814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a6c838f-e211-4953-bd1e-8161a3b6f5fc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:04.698257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a6c838f-e211-4953-bd1e-8161a3b6f5fc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:04.699008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a6c838f-e211-4953-bd1e-8161a3b6f5fc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:04.699440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a6c838f-e211-4953-bd1e-8161a3b6f5fc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:04.763155 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0a6c838f-e211-4953-bd1e-8161a3b6f5fc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:04.771007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0a6c838f-e211-4953-bd1e-8161a3b6f5fc tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.083800 Jul 18 17:14:04.771574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 747/1546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:04 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:05.493224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bc73429a-2220-4f61-9e38-4fee41853500 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:05.493876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bc73429a-2220-4f61-9e38-4fee41853500 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:05.500329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc73429a-2220-4f61-9e38-4fee41853500 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:05.500778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc73429a-2220-4f61-9e38-4fee41853500 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:05.501535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc73429a-2220-4f61-9e38-4fee41853500 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:05.501974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc73429a-2220-4f61-9e38-4fee41853500 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:05.566053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bc73429a-2220-4f61-9e38-4fee41853500 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:05.574099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bc73429a-2220-4f61-9e38-4fee41853500 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084780 Jul 18 17:14:05.574652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 748/1547] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:05 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:05.787843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d65bdcfb-a60a-4b10-b012-b9e9787fdfae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:05.788444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d65bdcfb-a60a-4b10-b012-b9e9787fdfae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:05.794579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d65bdcfb-a60a-4b10-b012-b9e9787fdfae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:05.795026 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d65bdcfb-a60a-4b10-b012-b9e9787fdfae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:05.795823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d65bdcfb-a60a-4b10-b012-b9e9787fdfae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:05.796258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d65bdcfb-a60a-4b10-b012-b9e9787fdfae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:05.856904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d65bdcfb-a60a-4b10-b012-b9e9787fdfae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:05.864845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d65bdcfb-a60a-4b10-b012-b9e9787fdfae tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.080862 Jul 18 17:14:05.865404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 749/1548] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:05 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:06.590407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2339b1d0-76ff-4288-833c-522099665bef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:06.591097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2339b1d0-76ff-4288-833c-522099665bef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:06.597495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2339b1d0-76ff-4288-833c-522099665bef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:06.597943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2339b1d0-76ff-4288-833c-522099665bef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:06.598706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2339b1d0-76ff-4288-833c-522099665bef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:06.599150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2339b1d0-76ff-4288-833c-522099665bef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:06.660516 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2339b1d0-76ff-4288-833c-522099665bef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:06.668978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2339b1d0-76ff-4288-833c-522099665bef tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081917 Jul 18 17:14:06.669534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 750/1549] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:06 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:06.881958 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-13bf2789-d8b9-4e64-a5be-143bb3c42779 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:06.882541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-13bf2789-d8b9-4e64-a5be-143bb3c42779 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:06.888714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13bf2789-d8b9-4e64-a5be-143bb3c42779 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:06.889209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13bf2789-d8b9-4e64-a5be-143bb3c42779 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:06.889972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13bf2789-d8b9-4e64-a5be-143bb3c42779 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:06.890401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13bf2789-d8b9-4e64-a5be-143bb3c42779 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:06.952306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-13bf2789-d8b9-4e64-a5be-143bb3c42779 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:06.960409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-13bf2789-d8b9-4e64-a5be-143bb3c42779 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082407 Jul 18 17:14:06.961020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 751/1550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:06 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:07.686783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b6b5d684-5a90-4177-91ea-524af76ab235 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:07.687478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b6b5d684-5a90-4177-91ea-524af76ab235 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:07.693917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6b5d684-5a90-4177-91ea-524af76ab235 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:07.694371 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6b5d684-5a90-4177-91ea-524af76ab235 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:07.695140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6b5d684-5a90-4177-91ea-524af76ab235 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:07.695600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6b5d684-5a90-4177-91ea-524af76ab235 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:07.760480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b6b5d684-5a90-4177-91ea-524af76ab235 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:07.769510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b6b5d684-5a90-4177-91ea-524af76ab235 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.087391 Jul 18 17:14:07.770075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 752/1551] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:07 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:07.977841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-82bfa39c-1730-485f-8079-7eb685d45d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:07.978364 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-82bfa39c-1730-485f-8079-7eb685d45d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:07.980266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=94 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:14:07.985571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82bfa39c-1730-485f-8079-7eb685d45d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:07.986016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82bfa39c-1730-485f-8079-7eb685d45d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:07.986773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82bfa39c-1730-485f-8079-7eb685d45d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:07.987211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82bfa39c-1730-485f-8079-7eb685d45d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:08.048310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-82bfa39c-1730-485f-8079-7eb685d45d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:08.056437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-82bfa39c-1730-485f-8079-7eb685d45d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082315 Jul 18 17:14:08.056811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 753/1552] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:07 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:08.786970 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3ee4d006-9c82-4e21-bb56-cd0e1c33f236 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:08.787689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3ee4d006-9c82-4e21-bb56-cd0e1c33f236 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:08.794122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ee4d006-9c82-4e21-bb56-cd0e1c33f236 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:08.794573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ee4d006-9c82-4e21-bb56-cd0e1c33f236 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:08.795427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ee4d006-9c82-4e21-bb56-cd0e1c33f236 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:08.795893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ee4d006-9c82-4e21-bb56-cd0e1c33f236 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:08.866879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3ee4d006-9c82-4e21-bb56-cd0e1c33f236 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:08.875595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3ee4d006-9c82-4e21-bb56-cd0e1c33f236 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.092455 Jul 18 17:14:08.876152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 754/1553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:08 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:09.074091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-64393666-a284-472d-80dc-d9aa012db1bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:09.075425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-64393666-a284-472d-80dc-d9aa012db1bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:09.081567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64393666-a284-472d-80dc-d9aa012db1bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:09.082306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64393666-a284-472d-80dc-d9aa012db1bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:09.083077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64393666-a284-472d-80dc-d9aa012db1bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:09.083535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-64393666-a284-472d-80dc-d9aa012db1bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:09.144705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-64393666-a284-472d-80dc-d9aa012db1bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:09.152735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-64393666-a284-472d-80dc-d9aa012db1bb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082616 Jul 18 17:14:09.153466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 755/1554] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:09 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:09.891839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4f3c0d77-dee0-4cb1-8449-6b2cd397ec5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:09.892613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4f3c0d77-dee0-4cb1-8449-6b2cd397ec5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:09.899035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f3c0d77-dee0-4cb1-8449-6b2cd397ec5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:09.899484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f3c0d77-dee0-4cb1-8449-6b2cd397ec5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:09.900280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f3c0d77-dee0-4cb1-8449-6b2cd397ec5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:09.900722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f3c0d77-dee0-4cb1-8449-6b2cd397ec5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:09.968072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f3c0d77-dee0-4cb1-8449-6b2cd397ec5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:09.976185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4f3c0d77-dee0-4cb1-8449-6b2cd397ec5c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088499 Jul 18 17:14:09.976742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 756/1555] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:09 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:10.169866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b0db9c92-1552-4414-807e-9858bd958804 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:10.170476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b0db9c92-1552-4414-807e-9858bd958804 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:10.177041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0db9c92-1552-4414-807e-9858bd958804 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:10.177520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0db9c92-1552-4414-807e-9858bd958804 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:10.178285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0db9c92-1552-4414-807e-9858bd958804 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:10.178726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0db9c92-1552-4414-807e-9858bd958804 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:10.240588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b0db9c92-1552-4414-807e-9858bd958804 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:10.248982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b0db9c92-1552-4414-807e-9858bd958804 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.083215 Jul 18 17:14:10.249556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 757/1556] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:10 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:10.993978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8b3097de-df05-407a-b2f2-b0a03d670af1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:10.994679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8b3097de-df05-407a-b2f2-b0a03d670af1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:11.002003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8b3097de-df05-407a-b2f2-b0a03d670af1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:11.002459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8b3097de-df05-407a-b2f2-b0a03d670af1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:11.003239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8b3097de-df05-407a-b2f2-b0a03d670af1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:11.003714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8b3097de-df05-407a-b2f2-b0a03d670af1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:11.083906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8b3097de-df05-407a-b2f2-b0a03d670af1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:11.092634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8b3097de-df05-407a-b2f2-b0a03d670af1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.102490 Jul 18 17:14:11.093220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 758/1557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:10 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:11.266630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f48278f2-120b-4228-8270-5ddbe6a14938 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:11.267233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f48278f2-120b-4228-8270-5ddbe6a14938 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:11.273440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f48278f2-120b-4228-8270-5ddbe6a14938 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:11.273882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f48278f2-120b-4228-8270-5ddbe6a14938 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:11.274635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f48278f2-120b-4228-8270-5ddbe6a14938 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:11.275066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f48278f2-120b-4228-8270-5ddbe6a14938 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:11.339343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f48278f2-120b-4228-8270-5ddbe6a14938 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:11.347327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f48278f2-120b-4228-8270-5ddbe6a14938 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.085200 Jul 18 17:14:11.347923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 759/1558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:11 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:12.110279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-df4cd8b4-acdf-469d-84ce-df865a66a098 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:12.110940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-df4cd8b4-acdf-469d-84ce-df865a66a098 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:12.117321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-df4cd8b4-acdf-469d-84ce-df865a66a098 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:12.117772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-df4cd8b4-acdf-469d-84ce-df865a66a098 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:12.118543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-df4cd8b4-acdf-469d-84ce-df865a66a098 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:12.118983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-df4cd8b4-acdf-469d-84ce-df865a66a098 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:12.181114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-df4cd8b4-acdf-469d-84ce-df865a66a098 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:12.189050 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-df4cd8b4-acdf-469d-84ce-df865a66a098 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083385 Jul 18 17:14:12.189613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 760/1559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:12 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:12.365843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-54e9dfe2-939c-4f8f-bbfc-62c2a5382936 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:12.366358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-54e9dfe2-939c-4f8f-bbfc-62c2a5382936 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:12.372602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-54e9dfe2-939c-4f8f-bbfc-62c2a5382936 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:12.373053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-54e9dfe2-939c-4f8f-bbfc-62c2a5382936 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:12.373831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-54e9dfe2-939c-4f8f-bbfc-62c2a5382936 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:12.374266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-54e9dfe2-939c-4f8f-bbfc-62c2a5382936 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:12.377055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:14:12.437374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-54e9dfe2-939c-4f8f-bbfc-62c2a5382936 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:12.445487 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-54e9dfe2-939c-4f8f-bbfc-62c2a5382936 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.083627 Jul 18 17:14:12.446018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 761/1560] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:12 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:13.205953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-473627f8-62da-469e-afae-8bffb7353608 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:13.206597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-473627f8-62da-469e-afae-8bffb7353608 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:13.213125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-473627f8-62da-469e-afae-8bffb7353608 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:13.213580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-473627f8-62da-469e-afae-8bffb7353608 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:13.214346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-473627f8-62da-469e-afae-8bffb7353608 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:13.214786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-473627f8-62da-469e-afae-8bffb7353608 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:13.277754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-473627f8-62da-469e-afae-8bffb7353608 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:13.285844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-473627f8-62da-469e-afae-8bffb7353608 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083865 Jul 18 17:14:13.286402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 762/1561] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:13 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:13.462997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2c6e9d6e-4504-42ed-bee9-60a0e442db9c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:13.463524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2c6e9d6e-4504-42ed-bee9-60a0e442db9c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:13.469962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2c6e9d6e-4504-42ed-bee9-60a0e442db9c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:13.470400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2c6e9d6e-4504-42ed-bee9-60a0e442db9c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:13.471139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2c6e9d6e-4504-42ed-bee9-60a0e442db9c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:13.471594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2c6e9d6e-4504-42ed-bee9-60a0e442db9c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:13.536973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2c6e9d6e-4504-42ed-bee9-60a0e442db9c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:13.546087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2c6e9d6e-4504-42ed-bee9-60a0e442db9c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.086991 Jul 18 17:14:13.546661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 763/1562] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:13 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:14.303876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-946d3412-9a14-4bdd-859d-7dbaeef3a3aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:14.304551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-946d3412-9a14-4bdd-859d-7dbaeef3a3aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:14.312013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-946d3412-9a14-4bdd-859d-7dbaeef3a3aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:14.312466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-946d3412-9a14-4bdd-859d-7dbaeef3a3aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:14.313230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-946d3412-9a14-4bdd-859d-7dbaeef3a3aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:14.313670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-946d3412-9a14-4bdd-859d-7dbaeef3a3aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:14.362229 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:14:14.362826 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:14:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:14:14.377721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-946d3412-9a14-4bdd-859d-7dbaeef3a3aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:14.385729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-946d3412-9a14-4bdd-859d-7dbaeef3a3aa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085758 Jul 18 17:14:14.386294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 764/1563] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:14 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:14.563510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9780d089-d5cb-429d-a964-1ab14644c78f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:14.564204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9780d089-d5cb-429d-a964-1ab14644c78f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:14.570288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9780d089-d5cb-429d-a964-1ab14644c78f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:14.570736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9780d089-d5cb-429d-a964-1ab14644c78f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:14.571517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9780d089-d5cb-429d-a964-1ab14644c78f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:14.571957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9780d089-d5cb-429d-a964-1ab14644c78f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:14.635481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9780d089-d5cb-429d-a964-1ab14644c78f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:14.645033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9780d089-d5cb-429d-a964-1ab14644c78f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.086190 Jul 18 17:14:14.645572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 765/1564] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:14 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:15.402316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bd5b2f53-0468-43a3-baeb-b27886e2f2a4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:15.403579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bd5b2f53-0468-43a3-baeb-b27886e2f2a4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:15.410111 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd5b2f53-0468-43a3-baeb-b27886e2f2a4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:15.410538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd5b2f53-0468-43a3-baeb-b27886e2f2a4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:15.411319 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd5b2f53-0468-43a3-baeb-b27886e2f2a4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:15.411763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bd5b2f53-0468-43a3-baeb-b27886e2f2a4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:15.476137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bd5b2f53-0468-43a3-baeb-b27886e2f2a4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:15.484152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bd5b2f53-0468-43a3-baeb-b27886e2f2a4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085758 Jul 18 17:14:15.484715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 766/1565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:15 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:15.663071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4723f747-1390-4727-aea7-95b819e61ae5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:15.663615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4723f747-1390-4727-aea7-95b819e61ae5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:15.669779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4723f747-1390-4727-aea7-95b819e61ae5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:15.670225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4723f747-1390-4727-aea7-95b819e61ae5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:15.670985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4723f747-1390-4727-aea7-95b819e61ae5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:15.671419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4723f747-1390-4727-aea7-95b819e61ae5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:15.736024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4723f747-1390-4727-aea7-95b819e61ae5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:15.744384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4723f747-1390-4727-aea7-95b819e61ae5 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.085187 Jul 18 17:14:15.744956 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 767/1566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:15 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:16.500928 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7aafa434-9edc-4fb8-915d-08838e63a8fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:16.501666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7aafa434-9edc-4fb8-915d-08838e63a8fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:16.507985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7aafa434-9edc-4fb8-915d-08838e63a8fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:16.508430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7aafa434-9edc-4fb8-915d-08838e63a8fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:16.509183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7aafa434-9edc-4fb8-915d-08838e63a8fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:16.509616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7aafa434-9edc-4fb8-915d-08838e63a8fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:16.572131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7aafa434-9edc-4fb8-915d-08838e63a8fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:16.580545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7aafa434-9edc-4fb8-915d-08838e63a8fb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083481 Jul 18 17:14:16.581110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 768/1567] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:16 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:16.761593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9ed67871-bbf8-475b-9ed3-b7235f00bad8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:16.762300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9ed67871-bbf8-475b-9ed3-b7235f00bad8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:16.768363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ed67871-bbf8-475b-9ed3-b7235f00bad8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:16.768801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ed67871-bbf8-475b-9ed3-b7235f00bad8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:16.769546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ed67871-bbf8-475b-9ed3-b7235f00bad8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:16.769980 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ed67871-bbf8-475b-9ed3-b7235f00bad8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:16.832637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9ed67871-bbf8-475b-9ed3-b7235f00bad8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:16.841404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9ed67871-bbf8-475b-9ed3-b7235f00bad8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.083679 Jul 18 17:14:16.841978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 769/1568] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:16 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:17.597329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f6c8a9e5-419d-4c8a-8bee-e8348064cca3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:17.597976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f6c8a9e5-419d-4c8a-8bee-e8348064cca3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:17.604400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f6c8a9e5-419d-4c8a-8bee-e8348064cca3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:17.604840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f6c8a9e5-419d-4c8a-8bee-e8348064cca3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:17.606111 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f6c8a9e5-419d-4c8a-8bee-e8348064cca3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:17.606602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f6c8a9e5-419d-4c8a-8bee-e8348064cca3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:17.669817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f6c8a9e5-419d-4c8a-8bee-e8348064cca3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:17.678016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f6c8a9e5-419d-4c8a-8bee-e8348064cca3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084494 Jul 18 17:14:17.678740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 770/1569] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:17 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:17.858657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-48378f4d-ea70-4e77-b6da-82ed7bf9248c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:17.859260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-48378f4d-ea70-4e77-b6da-82ed7bf9248c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:17.865277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48378f4d-ea70-4e77-b6da-82ed7bf9248c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:17.865725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48378f4d-ea70-4e77-b6da-82ed7bf9248c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:17.866485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48378f4d-ea70-4e77-b6da-82ed7bf9248c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:17.866922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48378f4d-ea70-4e77-b6da-82ed7bf9248c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:17.930862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-48378f4d-ea70-4e77-b6da-82ed7bf9248c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:17.939443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-48378f4d-ea70-4e77-b6da-82ed7bf9248c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.085150 Jul 18 17:14:17.940084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 771/1570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:17 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:18.696422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-af2bde1d-b0d0-4a39-8bf6-0857e6c760bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:18.697106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-af2bde1d-b0d0-4a39-8bf6-0857e6c760bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:18.703822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af2bde1d-b0d0-4a39-8bf6-0857e6c760bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:18.704270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af2bde1d-b0d0-4a39-8bf6-0857e6c760bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:18.705030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af2bde1d-b0d0-4a39-8bf6-0857e6c760bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:18.705466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af2bde1d-b0d0-4a39-8bf6-0857e6c760bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:18.769169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-af2bde1d-b0d0-4a39-8bf6-0857e6c760bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:18.777752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-af2bde1d-b0d0-4a39-8bf6-0857e6c760bc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085596 Jul 18 17:14:18.778317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 772/1571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:18 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:18.956577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7fc186ff-c60f-4179-8126-6a2cd018c500 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:18.957137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7fc186ff-c60f-4179-8126-6a2cd018c500 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:18.963261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7fc186ff-c60f-4179-8126-6a2cd018c500 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:18.963741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7fc186ff-c60f-4179-8126-6a2cd018c500 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:18.964551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7fc186ff-c60f-4179-8126-6a2cd018c500 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:18.965023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7fc186ff-c60f-4179-8126-6a2cd018c500 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:19.026235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7fc186ff-c60f-4179-8126-6a2cd018c500 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:19.034652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7fc186ff-c60f-4179-8126-6a2cd018c500 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082057 Jul 18 17:14:19.035221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 773/1572] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:18 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:19.794211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-38b0277e-8ec4-401e-be6d-b391c618f27b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:19.794912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-38b0277e-8ec4-401e-be6d-b391c618f27b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:19.801496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-38b0277e-8ec4-401e-be6d-b391c618f27b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:19.801937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-38b0277e-8ec4-401e-be6d-b391c618f27b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:19.802718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-38b0277e-8ec4-401e-be6d-b391c618f27b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:19.803148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-38b0277e-8ec4-401e-be6d-b391c618f27b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:19.867993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-38b0277e-8ec4-401e-be6d-b391c618f27b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:19.876508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-38b0277e-8ec4-401e-be6d-b391c618f27b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086227 Jul 18 17:14:19.877059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 774/1573] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:19 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:20.051230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-496c829d-4c9a-4f3b-b109-51b88649ee2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:20.051774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-496c829d-4c9a-4f3b-b109-51b88649ee2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:20.057909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-496c829d-4c9a-4f3b-b109-51b88649ee2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:20.058350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-496c829d-4c9a-4f3b-b109-51b88649ee2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:20.059810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-496c829d-4c9a-4f3b-b109-51b88649ee2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:20.060264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-496c829d-4c9a-4f3b-b109-51b88649ee2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:20.125514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-496c829d-4c9a-4f3b-b109-51b88649ee2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:20.133676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-496c829d-4c9a-4f3b-b109-51b88649ee2f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.086647 Jul 18 17:14:20.134225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 775/1574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:20 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:20.893657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-19de918f-352b-478a-9617-9626390ff92c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:20.894358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-19de918f-352b-478a-9617-9626390ff92c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:20.901028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19de918f-352b-478a-9617-9626390ff92c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:20.901476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19de918f-352b-478a-9617-9626390ff92c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:20.902905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19de918f-352b-478a-9617-9626390ff92c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:20.903354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-19de918f-352b-478a-9617-9626390ff92c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:20.966542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-19de918f-352b-478a-9617-9626390ff92c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:20.974511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-19de918f-352b-478a-9617-9626390ff92c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084780 Jul 18 17:14:20.975071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 776/1575] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:20 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:21.150685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0d71004a-5322-4c46-bd0f-edc0414ff36e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:21.151202 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0d71004a-5322-4c46-bd0f-edc0414ff36e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:21.157478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d71004a-5322-4c46-bd0f-edc0414ff36e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:21.157922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d71004a-5322-4c46-bd0f-edc0414ff36e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:21.158675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d71004a-5322-4c46-bd0f-edc0414ff36e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:21.159109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d71004a-5322-4c46-bd0f-edc0414ff36e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:21.219977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0d71004a-5322-4c46-bd0f-edc0414ff36e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:21.222724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:14:21.229408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0d71004a-5322-4c46-bd0f-edc0414ff36e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082582 Jul 18 17:14:21.235725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 777/1576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:21 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:21.991322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d09ccee2-788e-4270-95dc-3daec3674587 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:21.992064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d09ccee2-788e-4270-95dc-3daec3674587 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:21.999222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d09ccee2-788e-4270-95dc-3daec3674587 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:21.999718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d09ccee2-788e-4270-95dc-3daec3674587 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:22.000492 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d09ccee2-788e-4270-95dc-3daec3674587 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:22.000940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d09ccee2-788e-4270-95dc-3daec3674587 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:22.065177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d09ccee2-788e-4270-95dc-3daec3674587 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:22.073161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d09ccee2-788e-4270-95dc-3daec3674587 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085733 Jul 18 17:14:22.073725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 778/1577] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:22.250710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-765d2c54-5dbc-49be-ab35-e06bc7470d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:22.251319 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-765d2c54-5dbc-49be-ab35-e06bc7470d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:22.257458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-765d2c54-5dbc-49be-ab35-e06bc7470d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:22.257916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-765d2c54-5dbc-49be-ab35-e06bc7470d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:22.258674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-765d2c54-5dbc-49be-ab35-e06bc7470d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:22.259111 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-765d2c54-5dbc-49be-ab35-e06bc7470d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:22.324659 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-765d2c54-5dbc-49be-ab35-e06bc7470d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:22.332905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-765d2c54-5dbc-49be-ab35-e06bc7470d31 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.086560 Jul 18 17:14:22.333468 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 779/1578] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:22 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:23.090488 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b93cbbf6-3a4a-45d9-a5ea-846e2046600d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:23.091133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b93cbbf6-3a4a-45d9-a5ea-846e2046600d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:23.097498 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b93cbbf6-3a4a-45d9-a5ea-846e2046600d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:23.097941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b93cbbf6-3a4a-45d9-a5ea-846e2046600d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:23.098695 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b93cbbf6-3a4a-45d9-a5ea-846e2046600d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:23.099130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b93cbbf6-3a4a-45d9-a5ea-846e2046600d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:23.165762 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b93cbbf6-3a4a-45d9-a5ea-846e2046600d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:23.171424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b93cbbf6-3a4a-45d9-a5ea-846e2046600d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084868 Jul 18 17:14:23.172296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 780/1579] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:23 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:23.350326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ebc2d8fb-47ce-4cf3-9122-aa27e61b3318 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:23.350843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ebc2d8fb-47ce-4cf3-9122-aa27e61b3318 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:23.357566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ebc2d8fb-47ce-4cf3-9122-aa27e61b3318 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:23.358008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ebc2d8fb-47ce-4cf3-9122-aa27e61b3318 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:23.358753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ebc2d8fb-47ce-4cf3-9122-aa27e61b3318 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:23.359183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ebc2d8fb-47ce-4cf3-9122-aa27e61b3318 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:23.420151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ebc2d8fb-47ce-4cf3-9122-aa27e61b3318 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:23.428412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ebc2d8fb-47ce-4cf3-9122-aa27e61b3318 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082037 Jul 18 17:14:23.428973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 781/1580] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:23 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:24.189560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d3f8293e-9ecb-47fd-a86c-44ddab97d73e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:24.190166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d3f8293e-9ecb-47fd-a86c-44ddab97d73e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:24.196639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d3f8293e-9ecb-47fd-a86c-44ddab97d73e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:24.197090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d3f8293e-9ecb-47fd-a86c-44ddab97d73e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:24.197843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d3f8293e-9ecb-47fd-a86c-44ddab97d73e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:24.198272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d3f8293e-9ecb-47fd-a86c-44ddab97d73e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:24.259969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d3f8293e-9ecb-47fd-a86c-44ddab97d73e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:24.268519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d3f8293e-9ecb-47fd-a86c-44ddab97d73e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083041 Jul 18 17:14:24.269090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 782/1581] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:24.445249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-22acf958-eb3c-435f-ae68-bd81f29e2555 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:24.445776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-22acf958-eb3c-435f-ae68-bd81f29e2555 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:24.451791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-22acf958-eb3c-435f-ae68-bd81f29e2555 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:24.452235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-22acf958-eb3c-435f-ae68-bd81f29e2555 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:24.453003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-22acf958-eb3c-435f-ae68-bd81f29e2555 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:24.453434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-22acf958-eb3c-435f-ae68-bd81f29e2555 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:24.516654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-22acf958-eb3c-435f-ae68-bd81f29e2555 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:24.524698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-22acf958-eb3c-435f-ae68-bd81f29e2555 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.083351 Jul 18 17:14:24.525254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 783/1582] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:24 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:25.285198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-26eee31a-f434-4b68-aee1-16bac8c140b9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:25.285896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-26eee31a-f434-4b68-aee1-16bac8c140b9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:25.292348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-26eee31a-f434-4b68-aee1-16bac8c140b9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:25.292870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-26eee31a-f434-4b68-aee1-16bac8c140b9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:25.293680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-26eee31a-f434-4b68-aee1-16bac8c140b9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:25.294205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-26eee31a-f434-4b68-aee1-16bac8c140b9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:25.357213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-26eee31a-f434-4b68-aee1-16bac8c140b9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:25.366207 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-26eee31a-f434-4b68-aee1-16bac8c140b9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084961 Jul 18 17:14:25.366772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 784/1583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:25 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:25.541849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-eff87a03-9f32-4d7c-bb46-6a854d5f352d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:25.542371 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-eff87a03-9f32-4d7c-bb46-6a854d5f352d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:25.548996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eff87a03-9f32-4d7c-bb46-6a854d5f352d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:25.549445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eff87a03-9f32-4d7c-bb46-6a854d5f352d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:25.550227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eff87a03-9f32-4d7c-bb46-6a854d5f352d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:25.550665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eff87a03-9f32-4d7c-bb46-6a854d5f352d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:25.621720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-eff87a03-9f32-4d7c-bb46-6a854d5f352d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:25.632079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-eff87a03-9f32-4d7c-bb46-6a854d5f352d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.094219 Jul 18 17:14:25.632648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 785/1584] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:25 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:26.383209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bf851e66-4470-4ac7-93ef-5b8038b6ce4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:26.383930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bf851e66-4470-4ac7-93ef-5b8038b6ce4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:26.390354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf851e66-4470-4ac7-93ef-5b8038b6ce4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:26.390804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf851e66-4470-4ac7-93ef-5b8038b6ce4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:26.391581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf851e66-4470-4ac7-93ef-5b8038b6ce4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:26.392043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf851e66-4470-4ac7-93ef-5b8038b6ce4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:26.455329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bf851e66-4470-4ac7-93ef-5b8038b6ce4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:26.463182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bf851e66-4470-4ac7-93ef-5b8038b6ce4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083971 Jul 18 17:14:26.463765 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 786/1585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:26 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:26.650331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d4a9c2fb-945c-4a75-9ab8-5f8c11b739b7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:26.650946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d4a9c2fb-945c-4a75-9ab8-5f8c11b739b7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:26.657711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d4a9c2fb-945c-4a75-9ab8-5f8c11b739b7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:26.658161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d4a9c2fb-945c-4a75-9ab8-5f8c11b739b7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:26.658923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d4a9c2fb-945c-4a75-9ab8-5f8c11b739b7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:26.659364 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d4a9c2fb-945c-4a75-9ab8-5f8c11b739b7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:26.723405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d4a9c2fb-945c-4a75-9ab8-5f8c11b739b7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:26.731736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d4a9c2fb-945c-4a75-9ab8-5f8c11b739b7 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.085229 Jul 18 17:14:26.732301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 787/1586] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:26 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:27.481415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f7049347-7c25-46f1-81ff-21cb78f70dc6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:27.482069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f7049347-7c25-46f1-81ff-21cb78f70dc6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:27.488598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7049347-7c25-46f1-81ff-21cb78f70dc6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:27.489046 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7049347-7c25-46f1-81ff-21cb78f70dc6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:27.489792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7049347-7c25-46f1-81ff-21cb78f70dc6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:27.490224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7049347-7c25-46f1-81ff-21cb78f70dc6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:27.550766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f7049347-7c25-46f1-81ff-21cb78f70dc6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:27.558806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f7049347-7c25-46f1-81ff-21cb78f70dc6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081502 Jul 18 17:14:27.559362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 788/1587] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:27 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:27.748401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b939814d-fcfb-442a-b1a5-5d2e9a9249c0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:27.749022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b939814d-fcfb-442a-b1a5-5d2e9a9249c0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:27.754999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b939814d-fcfb-442a-b1a5-5d2e9a9249c0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:27.755445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b939814d-fcfb-442a-b1a5-5d2e9a9249c0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:27.756233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b939814d-fcfb-442a-b1a5-5d2e9a9249c0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:27.756666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b939814d-fcfb-442a-b1a5-5d2e9a9249c0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:27.817939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b939814d-fcfb-442a-b1a5-5d2e9a9249c0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:27.826457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b939814d-fcfb-442a-b1a5-5d2e9a9249c0 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.082514 Jul 18 17:14:27.827208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 789/1588] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:27 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:28.576103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-61fa2f6e-20ad-4e7f-aa30-5635c936d5e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:28.576755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-61fa2f6e-20ad-4e7f-aa30-5635c936d5e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:28.583539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61fa2f6e-20ad-4e7f-aa30-5635c936d5e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:28.583994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61fa2f6e-20ad-4e7f-aa30-5635c936d5e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:28.584759 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61fa2f6e-20ad-4e7f-aa30-5635c936d5e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:28.585200 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61fa2f6e-20ad-4e7f-aa30-5635c936d5e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:28.646982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-61fa2f6e-20ad-4e7f-aa30-5635c936d5e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:28.655410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-61fa2f6e-20ad-4e7f-aa30-5635c936d5e4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083259 Jul 18 17:14:28.655999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 790/1589] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:28 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:28.843961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-53ae0afa-5fd9-45ed-9517-550d3fe235c8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:28.844616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-53ae0afa-5fd9-45ed-9517-550d3fe235c8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:28.850584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53ae0afa-5fd9-45ed-9517-550d3fe235c8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:28.851032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53ae0afa-5fd9-45ed-9517-550d3fe235c8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:28.851807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53ae0afa-5fd9-45ed-9517-550d3fe235c8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:28.852243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-53ae0afa-5fd9-45ed-9517-550d3fe235c8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:28.916548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-53ae0afa-5fd9-45ed-9517-550d3fe235c8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:28.924897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-53ae0afa-5fd9-45ed-9517-550d3fe235c8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.085480 Jul 18 17:14:28.925458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 791/1590] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:28 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:29.673529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6dbb0546-ba54-435c-97a5-ea2acc6818de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:29.674180 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6dbb0546-ba54-435c-97a5-ea2acc6818de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:29.681134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6dbb0546-ba54-435c-97a5-ea2acc6818de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:29.681581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6dbb0546-ba54-435c-97a5-ea2acc6818de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:29.682344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6dbb0546-ba54-435c-97a5-ea2acc6818de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:29.682787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6dbb0546-ba54-435c-97a5-ea2acc6818de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:29.745479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6dbb0546-ba54-435c-97a5-ea2acc6818de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:29.754027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6dbb0546-ba54-435c-97a5-ea2acc6818de tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085023 Jul 18 17:14:29.754594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 792/1591] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:29 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:29.941622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8501d9bd-a79d-4411-afed-44e4b30882d9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:29.942144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8501d9bd-a79d-4411-afed-44e4b30882d9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:29.948823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8501d9bd-a79d-4411-afed-44e4b30882d9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:29.949437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8501d9bd-a79d-4411-afed-44e4b30882d9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:29.950201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8501d9bd-a79d-4411-afed-44e4b30882d9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:29.950632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8501d9bd-a79d-4411-afed-44e4b30882d9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:30.017146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8501d9bd-a79d-4411-afed-44e4b30882d9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:30.028853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8501d9bd-a79d-4411-afed-44e4b30882d9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.091100 Jul 18 17:14:30.029425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 793/1592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:29 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:30.771016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c64edfcd-7b59-4472-90f0-0b3f7f964aea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:30.771734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c64edfcd-7b59-4472-90f0-0b3f7f964aea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:30.778879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c64edfcd-7b59-4472-90f0-0b3f7f964aea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:30.779325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c64edfcd-7b59-4472-90f0-0b3f7f964aea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:30.780115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c64edfcd-7b59-4472-90f0-0b3f7f964aea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:30.780558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c64edfcd-7b59-4472-90f0-0b3f7f964aea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:30.798069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:14:30.846061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c64edfcd-7b59-4472-90f0-0b3f7f964aea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:30.854170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c64edfcd-7b59-4472-90f0-0b3f7f964aea tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086997 Jul 18 17:14:30.854732 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 794/1593] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:30 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:31.097919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-abf268b3-6664-4e76-a97c-8270f7d71591 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:31.098530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-abf268b3-6664-4e76-a97c-8270f7d71591 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: 295d078f-10f9-4a6d-a3c4-9636ef01a6f7] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:31.104575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abf268b3-6664-4e76-a97c-8270f7d71591 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:31.105065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abf268b3-6664-4e76-a97c-8270f7d71591 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:31.105936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abf268b3-6664-4e76-a97c-8270f7d71591 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:31.106375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abf268b3-6664-4e76-a97c-8270f7d71591 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:31.170642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-abf268b3-6664-4e76-a97c-8270f7d71591 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:31.179000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-abf268b3-6664-4e76-a97c-8270f7d71591 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7" status: 200 len: 1350 microversion: 2.1 time: 0.136928 Jul 18 17:14:31.179622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 795/1594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:31 2022] GET /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:31.872120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-00a5e8a9-041a-475a-8a18-b82b1d3a6fa3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:31.872716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-00a5e8a9-041a-475a-8a18-b82b1d3a6fa3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:31.879316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00a5e8a9-041a-475a-8a18-b82b1d3a6fa3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:31.879792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00a5e8a9-041a-475a-8a18-b82b1d3a6fa3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:31.880559 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00a5e8a9-041a-475a-8a18-b82b1d3a6fa3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:31.881029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00a5e8a9-041a-475a-8a18-b82b1d3a6fa3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:31.944980 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-00a5e8a9-041a-475a-8a18-b82b1d3a6fa3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:31.953653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-00a5e8a9-041a-475a-8a18-b82b1d3a6fa3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085687 Jul 18 17:14:31.957075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 796/1595] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:32.971411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dafea2a2-39e9-40cb-bb61-2bd1c2181be0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:32.972108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-dafea2a2-39e9-40cb-bb61-2bd1c2181be0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:32.978669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dafea2a2-39e9-40cb-bb61-2bd1c2181be0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:32.979116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dafea2a2-39e9-40cb-bb61-2bd1c2181be0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:32.980542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dafea2a2-39e9-40cb-bb61-2bd1c2181be0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:32.981087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dafea2a2-39e9-40cb-bb61-2bd1c2181be0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:33.042066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-dafea2a2-39e9-40cb-bb61-2bd1c2181be0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:33.050973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dafea2a2-39e9-40cb-bb61-2bd1c2181be0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083388 Jul 18 17:14:33.051546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 797/1596] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:32 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:34.068157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5a4aa563-ac43-4495-a9b7-29b21a57560f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:34.068836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5a4aa563-ac43-4495-a9b7-29b21a57560f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:34.075702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a4aa563-ac43-4495-a9b7-29b21a57560f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:34.076179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a4aa563-ac43-4495-a9b7-29b21a57560f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:34.076942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a4aa563-ac43-4495-a9b7-29b21a57560f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:34.077374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a4aa563-ac43-4495-a9b7-29b21a57560f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:34.141717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5a4aa563-ac43-4495-a9b7-29b21a57560f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:34.149705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5a4aa563-ac43-4495-a9b7-29b21a57560f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085550 Jul 18 17:14:34.150268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 798/1597] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:34 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:34.417219 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b3e4c594-3a20-4e0d-8d7c-07c1d4664db6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:34.418237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b3e4c594-3a20-4e0d-8d7c-07c1d4664db6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:34.424608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3e4c594-3a20-4e0d-8d7c-07c1d4664db6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:34.425114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3e4c594-3a20-4e0d-8d7c-07c1d4664db6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:34.425797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3e4c594-3a20-4e0d-8d7c-07c1d4664db6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:34.426230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3e4c594-3a20-4e0d-8d7c-07c1d4664db6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:34.452347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b3e4c594-3a20-4e0d-8d7c-07c1d4664db6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:14:34.792072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b3e4c594-3a20-4e0d-8d7c-07c1d4664db6 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 204 len: 0 microversion: 2.1 time: 0.378092 Jul 18 17:14:34.793533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 799/1598] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:14:34 2022] DELETE /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:14:34.802033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f3521e0e-3d90-487b-88fb-77259cd4c4e9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:34.802717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f3521e0e-3d90-487b-88fb-77259cd4c4e9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:34.806154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:14:34.810647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f3521e0e-3d90-487b-88fb-77259cd4c4e9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:34.811099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f3521e0e-3d90-487b-88fb-77259cd4c4e9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:34.811969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f3521e0e-3d90-487b-88fb-77259cd4c4e9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:34.812405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f3521e0e-3d90-487b-88fb-77259cd4c4e9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:34.950581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f3521e0e-3d90-487b-88fb-77259cd4c4e9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:34.958237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f3521e0e-3d90-487b-88fb-77259cd4c4e9 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1507 microversion: 2.1 time: 0.160366 Jul 18 17:14:34.958833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 800/1599] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:34 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:35.166130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ec4e945b-6e18-475e-8c15-a5275bc842cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:35.166801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ec4e945b-6e18-475e-8c15-a5275bc842cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:35.173962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec4e945b-6e18-475e-8c15-a5275bc842cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:35.174414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec4e945b-6e18-475e-8c15-a5275bc842cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:35.175183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec4e945b-6e18-475e-8c15-a5275bc842cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:35.175771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ec4e945b-6e18-475e-8c15-a5275bc842cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:35.239053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ec4e945b-6e18-475e-8c15-a5275bc842cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:35.248053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ec4e945b-6e18-475e-8c15-a5275bc842cb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085599 Jul 18 17:14:35.248538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 801/1600] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:35 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:35.911126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-664246f4-9f58-472b-81c9-f6d145004dd9 req-4f192e91-958c-4b46-be21-9d742b65104d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed4624c-89d5-468c-bff4-3576ada7c0a9", "name": "network-vif-deleted", "tag": "cc4ff60b-9404-43c6-98e9-71dd77fc67c6"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:14:35.920008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-664246f4-9f58-472b-81c9-f6d145004dd9 req-4f192e91-958c-4b46-be21-9d742b65104d service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:35.920453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-664246f4-9f58-472b-81c9-f6d145004dd9 req-4f192e91-958c-4b46-be21-9d742b65104d service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:35.932078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-664246f4-9f58-472b-81c9-f6d145004dd9 req-4f192e91-958c-4b46-be21-9d742b65104d service nova] Creating event network-vif-deleted:cc4ff60b-9404-43c6-98e9-71dd77fc67c6 for instance 1ed4624c-89d5-468c-bff4-3576ada7c0a9 on hv-cinder-84617 Jul 18 17:14:35.937421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-664246f4-9f58-472b-81c9-f6d145004dd9 req-4f192e91-958c-4b46-be21-9d742b65104d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090729 Jul 18 17:14:35.938073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 802/1601] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:14:35.976445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-362583a4-7d3d-420a-91ee-896efa036dcc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:35.977123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-362583a4-7d3d-420a-91ee-896efa036dcc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:35.984258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-362583a4-7d3d-420a-91ee-896efa036dcc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:35.984701 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-362583a4-7d3d-420a-91ee-896efa036dcc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:35.985458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-362583a4-7d3d-420a-91ee-896efa036dcc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:35.985893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-362583a4-7d3d-420a-91ee-896efa036dcc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:36.051240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-362583a4-7d3d-420a-91ee-896efa036dcc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:36.059414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-362583a4-7d3d-420a-91ee-896efa036dcc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 200 len: 1465 microversion: 2.1 time: 0.087099 Jul 18 17:14:36.060032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 803/1602] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:35 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 1465 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:36.265414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-adeac750-8d0a-4c3d-a49b-993559faa228 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:36.266392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-adeac750-8d0a-4c3d-a49b-993559faa228 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:36.274017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-adeac750-8d0a-4c3d-a49b-993559faa228 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:36.274460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-adeac750-8d0a-4c3d-a49b-993559faa228 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:36.275271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-adeac750-8d0a-4c3d-a49b-993559faa228 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:36.275737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-adeac750-8d0a-4c3d-a49b-993559faa228 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:36.341905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-adeac750-8d0a-4c3d-a49b-993559faa228 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:36.349915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-adeac750-8d0a-4c3d-a49b-993559faa228 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.089016 Jul 18 17:14:36.350474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 804/1603] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:36 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:37.077428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:37.078063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: 1ed4624c-89d5-468c-bff4-3576ada7c0a9] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:37.084312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:37.084961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:37.085819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:37.086264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:37.100450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] HTTP exception thrown: Instance 1ed4624c-89d5-468c-bff4-3576ada7c0a9 could not be found. Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Request method failure captured: Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 HTTP/1.1 Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y5MWhmLR6v2w8S-LyWxPRgcC34RixV-8cPDNn9dS_bGgBpF8MjoYmHjFPtIDP8cJ9F8OQSL62PlItKTud-7cmiLxFty2i1PV0Vj7ts6m1No8Ts6r7-Ph7maB_FZFLrcOxY4WRg3E-sMjSxiADEblsLG4xB40GTnS4pkme3v840UBCo Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 69c48eddc2334918970e61725bedafd1 Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523664587 Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:14:37.102095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/69c48eddc2334918970e61725bedafd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_69c48eddc2334918970e61725bedafd1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/69c48eddc2334918970e61725bedafd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/69c48eddc2334918970e61725bedafd1"}]}] Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523664587 Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 69c48eddc2334918970e61725bedafd1 Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523664587 Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-ServerRescueNegativeTestJSON-1523664587-project Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 642ba7eed36e4956834c06b771259a42 Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523664587-project Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 1ed4624c-89d5-468c-bff4-3576ada7c0a9 could not be found. Jul 18 17:14:37.103812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '1ed4624c-89d5-468c-bff4-3576ada7c0a9'} Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed4624c-89d5-468c-bff4-3576ada7c0a9 could not be found. Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:14:37.105583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed4624c-89d5-468c-bff4-3576ada7c0a9 could not be found. Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed4624c-89d5-468c-bff4-3576ada7c0a9 could not be found. Jul 18 17:14:37.107156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:37.108799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Returning 404 to user: Instance 1ed4624c-89d5-468c-bff4-3576ada7c0a9 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:14:37.108799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0cd07fec-5c35-4879-b340-f758fecc97a1 tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9" status: 404 len: 111 microversion: 2.1 time: 0.030488 Jul 18 17:14:37.108799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 805/1604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:37 2022] GET /compute/v2.1/servers/1ed4624c-89d5-468c-bff4-3576ada7c0a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:14:37.112265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f0d67f57-1f2b-494b-beec-81bc3add03ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:37.112761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f0d67f57-1f2b-494b-beec-81bc3add03ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:37.119014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f0d67f57-1f2b-494b-beec-81bc3add03ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:37.119465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f0d67f57-1f2b-494b-beec-81bc3add03ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:37.121105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f0d67f57-1f2b-494b-beec-81bc3add03ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:37.122375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f0d67f57-1f2b-494b-beec-81bc3add03ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:37.147528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f0d67f57-1f2b-494b-beec-81bc3add03ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:14:37.447019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f0d67f57-1f2b-494b-beec-81bc3add03ec tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 204 len: 0 microversion: 2.1 time: 0.337966 Jul 18 17:14:37.447684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 806/1605] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:14:37 2022] DELETE /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:14:37.452729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-193c093f-fd05-44bc-bc24-b0868b4e06a7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:37.453432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-193c093f-fd05-44bc-bc24-b0868b4e06a7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:37.460430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-193c093f-fd05-44bc-bc24-b0868b4e06a7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:37.460871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-193c093f-fd05-44bc-bc24-b0868b4e06a7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:37.461646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-193c093f-fd05-44bc-bc24-b0868b4e06a7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:37.462101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-193c093f-fd05-44bc-bc24-b0868b4e06a7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:37.525813 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-193c093f-fd05-44bc-bc24-b0868b4e06a7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:37.534697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-193c093f-fd05-44bc-bc24-b0868b4e06a7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086066 Jul 18 17:14:37.535252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 807/1606] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:37 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:37.539636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-db9f2ed0-e5ad-4226-aadb-d82f28aed2fc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:37.540305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-db9f2ed0-e5ad-4226-aadb-d82f28aed2fc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:37.547201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db9f2ed0-e5ad-4226-aadb-d82f28aed2fc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:37.547683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db9f2ed0-e5ad-4226-aadb-d82f28aed2fc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:37.548447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db9f2ed0-e5ad-4226-aadb-d82f28aed2fc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:37.548886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db9f2ed0-e5ad-4226-aadb-d82f28aed2fc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:37.680721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-db9f2ed0-e5ad-4226-aadb-d82f28aed2fc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:37.688170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-db9f2ed0-e5ad-4226-aadb-d82f28aed2fc tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1521 microversion: 2.1 time: 0.151943 Jul 18 17:14:37.688733 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 808/1607] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:37 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:38.383133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-5d861d4a-21e4-4156-9317-34b89ee0c4ce req-59af1091-d191-4cfa-8235-b03a23eaddd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec9999e7-353f-4229-b587-c22a59c07d8b", "name": "network-vif-deleted", "tag": "85d1bdf4-c79d-49ad-895c-d1bd9ffbe943"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:14:38.392633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5d861d4a-21e4-4156-9317-34b89ee0c4ce req-59af1091-d191-4cfa-8235-b03a23eaddd3 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:38.393055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5d861d4a-21e4-4156-9317-34b89ee0c4ce req-59af1091-d191-4cfa-8235-b03a23eaddd3 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:38.396908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:14:38.404458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-5d861d4a-21e4-4156-9317-34b89ee0c4ce req-59af1091-d191-4cfa-8235-b03a23eaddd3 service nova] Creating event network-vif-deleted:85d1bdf4-c79d-49ad-895c-d1bd9ffbe943 for instance ec9999e7-353f-4229-b587-c22a59c07d8b on hv-cinder-84617 Jul 18 17:14:38.409364 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-5d861d4a-21e4-4156-9317-34b89ee0c4ce req-59af1091-d191-4cfa-8235-b03a23eaddd3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032717 Jul 18 17:14:38.409946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 809/1608] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:14:38.554229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a69487c2-e549-4658-9804-c242191d5402 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:38.554995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a69487c2-e549-4658-9804-c242191d5402 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:38.563230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a69487c2-e549-4658-9804-c242191d5402 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:38.563704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a69487c2-e549-4658-9804-c242191d5402 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:38.564507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a69487c2-e549-4658-9804-c242191d5402 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:38.564952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a69487c2-e549-4658-9804-c242191d5402 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:38.635400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a69487c2-e549-4658-9804-c242191d5402 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:38.644020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a69487c2-e549-4658-9804-c242191d5402 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.094373 Jul 18 17:14:38.644611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 810/1609] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:38 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:38.705626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:38.706091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:38.715055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:38.715596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:38.716401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:38.716846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:38.754037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:38.754507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:38.755050 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lazy-loading 'fault' on Instance uuid ec9999e7-353f-4229-b587-c22a59c07d8b {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:14:38.798516 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642ba7eed36e4956834c06b771259a42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c48eddc2334918970e61725bedafd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:38.806764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6c3cc0b8-d065-46e7-b48a-8d08ed4d706b tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 200 len: 1311 microversion: 2.1 time: 0.105369 Jul 18 17:14:38.807564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 811/1610] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:38 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:39.660229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-02381e3e-cb23-42c7-86bd-63151f69d26b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:39.660878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-02381e3e-cb23-42c7-86bd-63151f69d26b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:39.667412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02381e3e-cb23-42c7-86bd-63151f69d26b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:39.667974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02381e3e-cb23-42c7-86bd-63151f69d26b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:39.668738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02381e3e-cb23-42c7-86bd-63151f69d26b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:39.669180 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02381e3e-cb23-42c7-86bd-63151f69d26b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:39.732869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-02381e3e-cb23-42c7-86bd-63151f69d26b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:39.743041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-02381e3e-cb23-42c7-86bd-63151f69d26b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086504 Jul 18 17:14:39.743683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 812/1611] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:39 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:39.825481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:39.826295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] [instance: ec9999e7-353f-4229-b587-c22a59c07d8b] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:39.832551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:39.833005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:39.833780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:39.834276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:39.848482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] HTTP exception thrown: Instance ec9999e7-353f-4229-b587-c22a59c07d8b could not be found. Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Request method failure captured: Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b HTTP/1.1 Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y5MWhmLR6v2w8S-LyWxPRgcC34RixV-8cPDNn9dS_bGgBpF8MjoYmHjFPtIDP8cJ9F8OQSL62PlItKTud-7cmiLxFty2i1PV0Vj7ts6m1No8Ts6r7-Ph7maB_FZFLrcOxY4WRg3E-sMjSxiADEblsLG4xB40GTnS4pkme3v840UBCo Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 69c48eddc2334918970e61725bedafd1 Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523664587 Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:14:39.850139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/69c48eddc2334918970e61725bedafd1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_69c48eddc2334918970e61725bedafd1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/69c48eddc2334918970e61725bedafd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/69c48eddc2334918970e61725bedafd1"}]}] Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523664587 Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 69c48eddc2334918970e61725bedafd1 Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523664587 Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-ServerRescueNegativeTestJSON-1523664587-project Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 642ba7eed36e4956834c06b771259a42 Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523664587-project Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance ec9999e7-353f-4229-b587-c22a59c07d8b could not be found. Jul 18 17:14:39.851594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'ec9999e7-353f-4229-b587-c22a59c07d8b'} Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9999e7-353f-4229-b587-c22a59c07d8b could not be found. Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:14:39.852442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9999e7-353f-4229-b587-c22a59c07d8b could not be found. Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9999e7-353f-4229-b587-c22a59c07d8b could not be found. Jul 18 17:14:39.854001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:14:39.855605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] Returning 404 to user: Instance ec9999e7-353f-4229-b587-c22a59c07d8b could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:14:39.855605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8bc3e91b-f180-4d6d-bd5c-fa2b140cf41c tempest-ServerRescueNegativeTestJSON-1523664587 tempest-ServerRescueNegativeTestJSON-1523664587-project] 10.222.0.26 "GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b" status: 404 len: 111 microversion: 2.1 time: 0.030882 Jul 18 17:14:39.855605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 813/1612] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:39 2022] GET /compute/v2.1/servers/ec9999e7-353f-4229-b587-c22a59c07d8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:14:40.762521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5475d298-82aa-43c5-be5a-bf830ab965c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:40.763228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5475d298-82aa-43c5-be5a-bf830ab965c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:40.769595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5475d298-82aa-43c5-be5a-bf830ab965c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:40.770041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5475d298-82aa-43c5-be5a-bf830ab965c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:40.770998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5475d298-82aa-43c5-be5a-bf830ab965c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:40.771315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5475d298-82aa-43c5-be5a-bf830ab965c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:40.842642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5475d298-82aa-43c5-be5a-bf830ab965c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:40.851073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5475d298-82aa-43c5-be5a-bf830ab965c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.092683 Jul 18 17:14:40.851674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 814/1613] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:40 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:41.868165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7a879568-c3a8-4dba-8433-df546fd1f487 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:41.868846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7a879568-c3a8-4dba-8433-df546fd1f487 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:41.875452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a879568-c3a8-4dba-8433-df546fd1f487 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:41.875930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a879568-c3a8-4dba-8433-df546fd1f487 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:41.876699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a879568-c3a8-4dba-8433-df546fd1f487 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:41.877135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a879568-c3a8-4dba-8433-df546fd1f487 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:41.946619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7a879568-c3a8-4dba-8433-df546fd1f487 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:41.956920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7a879568-c3a8-4dba-8433-df546fd1f487 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.092604 Jul 18 17:14:41.957906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 815/1614] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:41 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:42.973536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0e52bed4-d389-41cb-b6ca-7aa6adf7750d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:42.974210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0e52bed4-d389-41cb-b6ca-7aa6adf7750d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:42.981657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e52bed4-d389-41cb-b6ca-7aa6adf7750d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:42.982324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e52bed4-d389-41cb-b6ca-7aa6adf7750d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:42.983099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e52bed4-d389-41cb-b6ca-7aa6adf7750d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:42.983725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e52bed4-d389-41cb-b6ca-7aa6adf7750d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:43.100596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0e52bed4-d389-41cb-b6ca-7aa6adf7750d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:43.112488 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0e52bed4-d389-41cb-b6ca-7aa6adf7750d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.142854 Jul 18 17:14:43.113598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 816/1615] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:42 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:43.859718 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:14:43.860257 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:14:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:14:44.133981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-db85f5da-cc9c-46c0-bf7e-25f8b2d7945e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:44.134607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-db85f5da-cc9c-46c0-bf7e-25f8b2d7945e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:44.145665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db85f5da-cc9c-46c0-bf7e-25f8b2d7945e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:44.146146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db85f5da-cc9c-46c0-bf7e-25f8b2d7945e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:44.146910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db85f5da-cc9c-46c0-bf7e-25f8b2d7945e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:44.147354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db85f5da-cc9c-46c0-bf7e-25f8b2d7945e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:44.234368 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-db85f5da-cc9c-46c0-bf7e-25f8b2d7945e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:44.243859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-db85f5da-cc9c-46c0-bf7e-25f8b2d7945e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.113761 Jul 18 17:14:44.250687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 817/1616] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:44 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:45.261660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1a273e1f-b362-4db2-9a29-5c5724c2f835 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:45.262373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1a273e1f-b362-4db2-9a29-5c5724c2f835 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:45.269553 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a273e1f-b362-4db2-9a29-5c5724c2f835 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:45.270098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a273e1f-b362-4db2-9a29-5c5724c2f835 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:45.270761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a273e1f-b362-4db2-9a29-5c5724c2f835 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:45.271202 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a273e1f-b362-4db2-9a29-5c5724c2f835 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:45.334505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1a273e1f-b362-4db2-9a29-5c5724c2f835 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:45.342901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1a273e1f-b362-4db2-9a29-5c5724c2f835 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085200 Jul 18 17:14:45.359972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 818/1617] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:45 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:46.361000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ca07600f-5273-4b45-87e8-73a2b7f70640 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:46.361668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ca07600f-5273-4b45-87e8-73a2b7f70640 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:46.368338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca07600f-5273-4b45-87e8-73a2b7f70640 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:46.368780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca07600f-5273-4b45-87e8-73a2b7f70640 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:46.369533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca07600f-5273-4b45-87e8-73a2b7f70640 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:46.369995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca07600f-5273-4b45-87e8-73a2b7f70640 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:46.448618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ca07600f-5273-4b45-87e8-73a2b7f70640 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:46.457188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ca07600f-5273-4b45-87e8-73a2b7f70640 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.099966 Jul 18 17:14:46.457893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 819/1618] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:46 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:47.479023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-901d76b9-36cb-428a-a223-4c071bf8eb4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:47.480382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-901d76b9-36cb-428a-a223-4c071bf8eb4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:47.489858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-901d76b9-36cb-428a-a223-4c071bf8eb4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:47.490675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-901d76b9-36cb-428a-a223-4c071bf8eb4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:47.491694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-901d76b9-36cb-428a-a223-4c071bf8eb4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:47.492302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-901d76b9-36cb-428a-a223-4c071bf8eb4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:47.575847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-901d76b9-36cb-428a-a223-4c071bf8eb4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:47.584236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-901d76b9-36cb-428a-a223-4c071bf8eb4c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.112124 Jul 18 17:14:47.594174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 820/1619] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:47 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:48.601988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-30be37ad-c4fa-46da-8789-7afdab1d70bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:48.602599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-30be37ad-c4fa-46da-8789-7afdab1d70bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:48.613204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-30be37ad-c4fa-46da-8789-7afdab1d70bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:48.614304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-30be37ad-c4fa-46da-8789-7afdab1d70bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:48.615253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-30be37ad-c4fa-46da-8789-7afdab1d70bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:48.615861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-30be37ad-c4fa-46da-8789-7afdab1d70bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:48.707485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-30be37ad-c4fa-46da-8789-7afdab1d70bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:48.719163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-30be37ad-c4fa-46da-8789-7afdab1d70bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.120862 Jul 18 17:14:48.731761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 821/1620] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:48 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:49.737768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-94cde6ac-8b8e-4feb-b700-535a94e45720 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:49.739048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-94cde6ac-8b8e-4feb-b700-535a94e45720 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:49.747061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-94cde6ac-8b8e-4feb-b700-535a94e45720 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:49.747724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-94cde6ac-8b8e-4feb-b700-535a94e45720 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:49.748658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-94cde6ac-8b8e-4feb-b700-535a94e45720 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:49.749256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-94cde6ac-8b8e-4feb-b700-535a94e45720 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:49.822915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-94cde6ac-8b8e-4feb-b700-535a94e45720 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:49.831432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-94cde6ac-8b8e-4feb-b700-535a94e45720 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.097370 Jul 18 17:14:49.832607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 822/1621] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:49 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:50.853781 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c4cfc2f5-dc55-43cf-8e70-39242b761210 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:50.853781 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c4cfc2f5-dc55-43cf-8e70-39242b761210 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:50.860073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4cfc2f5-dc55-43cf-8e70-39242b761210 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:50.860542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4cfc2f5-dc55-43cf-8e70-39242b761210 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:50.861328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4cfc2f5-dc55-43cf-8e70-39242b761210 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:50.861767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4cfc2f5-dc55-43cf-8e70-39242b761210 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:50.943560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c4cfc2f5-dc55-43cf-8e70-39242b761210 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:50.953471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c4cfc2f5-dc55-43cf-8e70-39242b761210 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.107598 Jul 18 17:14:50.954438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 823/1622] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:50 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:51.259167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fa9966d9-44ec-4615-926d-3db9ce0d0da8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'create', calling method: .version_select at 0x7fd6ae3d8940>, body: {"keypair": {"name": "tempest-keypair-2030415902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0LMFAgu45jlJzGi4SquNrZbFNz7IotRpfiQuhAK9zh59km6xf6gAPQ7bTLOBclPkThiK0nLvQfbP4cPqHWqH5hEolhOshju12LpZYGRlzwr4ObWzgmr0Z51d7jOyItqg=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:14:51.275078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-fa9966d9-44ec-4615-926d-3db9ce0d0da8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Getting quotas for project 1bad1610198d4b8aacfafc8c92dc7e6d. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:14:51.279721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-fa9966d9-44ec-4615-926d-3db9ce0d0da8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Getting quotas for user 9aec7436e3a549018fd7892969870019 and project 1bad1610198d4b8aacfafc8c92dc7e6d. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:14:51.385368 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fa9966d9-44ec-4615-926d-3db9ce0d0da8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.252389 Jul 18 17:14:51.385973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 824/1623] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jul 18 17:14:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 254 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 17:14:51.972636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-886005fb-19e8-48ba-a511-e7baddd9e8d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:51.973272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-886005fb-19e8-48ba-a511-e7baddd9e8d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:51.985632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-886005fb-19e8-48ba-a511-e7baddd9e8d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:51.985632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-886005fb-19e8-48ba-a511-e7baddd9e8d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:51.985632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-886005fb-19e8-48ba-a511-e7baddd9e8d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:51.985632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-886005fb-19e8-48ba-a511-e7baddd9e8d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:52.054769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-886005fb-19e8-48ba-a511-e7baddd9e8d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:52.065879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-886005fb-19e8-48ba-a511-e7baddd9e8d0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.098242 Jul 18 17:14:52.066562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 825/1624] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:51 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:53.083978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f21622e9-c911-4d55-ad75-d38713e70606 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:53.084649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f21622e9-c911-4d55-ad75-d38713e70606 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:53.091054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f21622e9-c911-4d55-ad75-d38713e70606 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:53.091439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f21622e9-c911-4d55-ad75-d38713e70606 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:53.092240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f21622e9-c911-4d55-ad75-d38713e70606 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:53.092679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f21622e9-c911-4d55-ad75-d38713e70606 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:53.159519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f21622e9-c911-4d55-ad75-d38713e70606 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:53.168262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f21622e9-c911-4d55-ad75-d38713e70606 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088275 Jul 18 17:14:53.170220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 826/1625] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:53 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:53.707609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1367004242", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e121000a-b4be-43f5-8f4d-03170f01894f"}], "security_groups": [{"name": "tempest-securitygroup--303886194"}], "key_name": "tempest-keypair-2030415902", "user_data": "}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:14:53.825926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] validate_networks() for [('e121000a-b4be-43f5-8f4d-03170f01894f', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:14:54.314495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:14:54.315770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:14:54.316427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:14:54.317188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:14:54.317605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:14:54.328654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:54.329104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:54.329914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:54.330350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:54.350115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Getting quotas for project 1bad1610198d4b8aacfafc8c92dc7e6d. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:14:54.355464 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Getting quotas for user 9aec7436e3a549018fd7892969870019 and project 1bad1610198d4b8aacfafc8c92dc7e6d. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:14:54.368515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:14:54.370792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:14:54.500189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-72f18f52-ac91-4ebe-932d-dcbbd473314c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.797004 Jul 18 17:14:54.501170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 827/1626] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jul 18 17:14:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 17:14:54.505884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5740c2fb-aeaa-4bd1-872c-e6f9bb892e39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:54.506744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5740c2fb-aeaa-4bd1-872c-e6f9bb892e39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:54.515690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5740c2fb-aeaa-4bd1-872c-e6f9bb892e39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:54.516404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5740c2fb-aeaa-4bd1-872c-e6f9bb892e39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:54.517420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5740c2fb-aeaa-4bd1-872c-e6f9bb892e39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:54.518034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5740c2fb-aeaa-4bd1-872c-e6f9bb892e39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:54.535172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:14:54.590981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5740c2fb-aeaa-4bd1-872c-e6f9bb892e39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:54.600516 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5740c2fb-aeaa-4bd1-872c-e6f9bb892e39 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.098114 Jul 18 17:14:54.600889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 828/1627] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:54 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:14:54.613396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9ec6308e-5396-4b07-a8de-7565f3204b32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:54.614029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9ec6308e-5396-4b07-a8de-7565f3204b32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:54.684738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9ec6308e-5396-4b07-a8de-7565f3204b32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:54.692696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9ec6308e-5396-4b07-a8de-7565f3204b32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:54.694985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9ec6308e-5396-4b07-a8de-7565f3204b32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:54.696875 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9ec6308e-5396-4b07-a8de-7565f3204b32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1282 microversion: 2.20 time: 0.091719 Jul 18 17:14:54.697616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 829/1628] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:14:54 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:14:55.617150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-319a5c24-1253-43dd-a0d2-fb4fb7f3f07b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:55.617851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-319a5c24-1253-43dd-a0d2-fb4fb7f3f07b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:55.626731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-319a5c24-1253-43dd-a0d2-fb4fb7f3f07b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:55.627173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-319a5c24-1253-43dd-a0d2-fb4fb7f3f07b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:55.627974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-319a5c24-1253-43dd-a0d2-fb4fb7f3f07b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:55.628412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-319a5c24-1253-43dd-a0d2-fb4fb7f3f07b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:55.936970 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-319a5c24-1253-43dd-a0d2-fb4fb7f3f07b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:55.945156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-319a5c24-1253-43dd-a0d2-fb4fb7f3f07b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.331822 Jul 18 17:14:55.945727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 830/1629] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:55 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:55.950462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:55.951014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:55.956934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:55.957464 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:55.959836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:55.959836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:56.023269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:56.032042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:56.033550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:56.034657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7a788fee-e5dc-4eb3-a411-7d83b370a6d6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1286 microversion: 2.20 time: 0.088013 Jul 18 17:14:56.035220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 831/1630] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:14:55 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:14:56.961748 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d0e5e949-0aab-42c0-b124-df3af4db36f5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:56.962402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d0e5e949-0aab-42c0-b124-df3af4db36f5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:56.964795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:14:56.971285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d0e5e949-0aab-42c0-b124-df3af4db36f5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:56.971757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d0e5e949-0aab-42c0-b124-df3af4db36f5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:56.973230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d0e5e949-0aab-42c0-b124-df3af4db36f5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:56.973669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d0e5e949-0aab-42c0-b124-df3af4db36f5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:57.054867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d0e5e949-0aab-42c0-b124-df3af4db36f5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:57.064157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d0e5e949-0aab-42c0-b124-df3af4db36f5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.106379 Jul 18 17:14:57.065178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 832/1631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:56 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:57.076698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:57.077502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:57.086434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:57.086891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:57.087702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:57.088146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:57.177694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:57.186656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:57.188192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:57.189309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-606da42a-eb4e-4c2e-b894-38542a756af9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1352 microversion: 2.20 time: 0.123339 Jul 18 17:14:57.190195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 833/1632] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:14:57 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:14:58.081741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3ec2facc-2cf1-4224-b282-3142f6f865eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:58.082427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3ec2facc-2cf1-4224-b282-3142f6f865eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:58.089960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ec2facc-2cf1-4224-b282-3142f6f865eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:58.090662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ec2facc-2cf1-4224-b282-3142f6f865eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:58.091649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ec2facc-2cf1-4224-b282-3142f6f865eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:58.092268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ec2facc-2cf1-4224-b282-3142f6f865eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:58.191393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3ec2facc-2cf1-4224-b282-3142f6f865eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:58.199455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3ec2facc-2cf1-4224-b282-3142f6f865eb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.121739 Jul 18 17:14:58.200777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 834/1633] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:58 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:58.207616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:58.208480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:58.214495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:58.215014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:58.216630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:58.217134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:58.425476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:58.434399 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:58.435927 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:58.437055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-792c86a6-f157-434b-87a2-18a37a733288 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1407 microversion: 2.20 time: 0.233407 Jul 18 17:14:58.437621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 835/1634] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:14:58 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:14:58.915432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-44034f96-4365-4247-a869-d5e49b37752f req-9dfe59e2-f663-434e-b933-848415b0815d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca39c53c-f52f-441d-b279-67c345389ce4", "tag": "fa747d07-5e03-4e26-8543-d0712de14cb7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:14:58.925074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-44034f96-4365-4247-a869-d5e49b37752f req-9dfe59e2-f663-434e-b933-848415b0815d service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:58.925528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-44034f96-4365-4247-a869-d5e49b37752f req-9dfe59e2-f663-434e-b933-848415b0815d service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:58.940693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-44034f96-4365-4247-a869-d5e49b37752f req-9dfe59e2-f663-434e-b933-848415b0815d service nova] Creating event network-changed:fa747d07-5e03-4e26-8543-d0712de14cb7 for instance ca39c53c-f52f-441d-b279-67c345389ce4 on hv-cinder-84617 Jul 18 17:14:58.945802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-44034f96-4365-4247-a869-d5e49b37752f req-9dfe59e2-f663-434e-b933-848415b0815d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034106 Jul 18 17:14:58.946772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 836/1635] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:14:59.218940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0d56ba97-2ec9-423d-a472-4a0501d96f73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:59.219684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0d56ba97-2ec9-423d-a472-4a0501d96f73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:59.225873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d56ba97-2ec9-423d-a472-4a0501d96f73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:59.226319 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d56ba97-2ec9-423d-a472-4a0501d96f73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:59.227088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d56ba97-2ec9-423d-a472-4a0501d96f73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:59.227549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d56ba97-2ec9-423d-a472-4a0501d96f73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:59.308400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0d56ba97-2ec9-423d-a472-4a0501d96f73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:59.316737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0d56ba97-2ec9-423d-a472-4a0501d96f73 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.103044 Jul 18 17:14:59.317324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 837/1636] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:14:59 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:14:59.455388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:14:59.456018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:14:59.462310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:59.462773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:59.463734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:14:59.464206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:14:59.679922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:59.688735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:59.690302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:14:59.691409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-de6fec8d-91c4-46d1-8b69-101421ffb5df tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1407 microversion: 2.20 time: 0.240052 Jul 18 17:14:59.691996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 838/1637] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:14:59 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:15:00.334105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a07c1427-ab1c-4e8c-acfb-bba929ba11c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:00.334743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a07c1427-ab1c-4e8c-acfb-bba929ba11c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:00.342003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a07c1427-ab1c-4e8c-acfb-bba929ba11c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:00.342455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a07c1427-ab1c-4e8c-acfb-bba929ba11c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:00.343231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a07c1427-ab1c-4e8c-acfb-bba929ba11c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:00.343706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a07c1427-ab1c-4e8c-acfb-bba929ba11c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:00.411259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a07c1427-ab1c-4e8c-acfb-bba929ba11c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:00.420791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a07c1427-ab1c-4e8c-acfb-bba929ba11c8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.090486 Jul 18 17:15:00.421343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 839/1638] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:00 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:00.710444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:00.711056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:00.717774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:00.718227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:00.718998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:00.719440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:00.851925 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:00.862141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:00.863974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:00.865308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-33c4cf9b-00ba-43fb-9df7-17c39e458d92 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1407 microversion: 2.20 time: 0.158999 Jul 18 17:15:00.865878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 840/1639] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:15:00 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:15:01.438606 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d08537f2-996d-480e-96d5-c3ca4c8ddaca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:01.439286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d08537f2-996d-480e-96d5-c3ca4c8ddaca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:01.445752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d08537f2-996d-480e-96d5-c3ca4c8ddaca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:01.446192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d08537f2-996d-480e-96d5-c3ca4c8ddaca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:01.446942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d08537f2-996d-480e-96d5-c3ca4c8ddaca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:01.447372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d08537f2-996d-480e-96d5-c3ca4c8ddaca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:01.510088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d08537f2-996d-480e-96d5-c3ca4c8ddaca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:01.518888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d08537f2-996d-480e-96d5-c3ca4c8ddaca tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084146 Jul 18 17:15:01.519447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 841/1640] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:01 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:01.882235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:01.882870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:01.889222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:01.889673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:01.890433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:01.890870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:02.033883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:02.042689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:02.044744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:02.045819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0ed76500-c963-4e06-b23a-845ac650eb69 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1407 microversion: 2.20 time: 0.167503 Jul 18 17:15:02.046375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 842/1641] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:15:01 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:15:02.535428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6aa67686-ec0c-4b0d-9659-9247289c12a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:02.536161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6aa67686-ec0c-4b0d-9659-9247289c12a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:02.543421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6aa67686-ec0c-4b0d-9659-9247289c12a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:02.543949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6aa67686-ec0c-4b0d-9659-9247289c12a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:02.544888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6aa67686-ec0c-4b0d-9659-9247289c12a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:02.545326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6aa67686-ec0c-4b0d-9659-9247289c12a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:02.608892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6aa67686-ec0c-4b0d-9659-9247289c12a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:02.617157 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6aa67686-ec0c-4b0d-9659-9247289c12a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085530 Jul 18 17:15:02.617735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 843/1642] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:02 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:03.064979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:03.065452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:03.071565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:03.072020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:03.072792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:03.073234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:03.209080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:03.217327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:03.218827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:03.219965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-584d289b-8e6e-4824-8856-03039b6080e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1407 microversion: 2.20 time: 0.159239 Jul 18 17:15:03.220521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 844/1643] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:15:03 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:15:03.635433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-07e886ba-deed-4bf7-a503-71f76c2f275f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:03.636146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-07e886ba-deed-4bf7-a503-71f76c2f275f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:03.643090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-07e886ba-deed-4bf7-a503-71f76c2f275f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:03.643640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-07e886ba-deed-4bf7-a503-71f76c2f275f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:03.645684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-07e886ba-deed-4bf7-a503-71f76c2f275f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:03.645684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-07e886ba-deed-4bf7-a503-71f76c2f275f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:03.713441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-07e886ba-deed-4bf7-a503-71f76c2f275f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:03.722063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-07e886ba-deed-4bf7-a503-71f76c2f275f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.090990 Jul 18 17:15:03.722671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 845/1644] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:03 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:04.238040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:04.238645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:04.245001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:04.245441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:04.246881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:04.247326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:04.342177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:15:04.392805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:04.394993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:15:04.401430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:04.404167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:04.405274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b3cb2e35-f3f0-4009-a5b8-ced916515561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1407 microversion: 2.20 time: 0.171260 Jul 18 17:15:04.408934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 846/1645] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:15:04 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:15:04.731058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=12 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:15:04.790437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-35c2a2f1-12cb-4ba1-a9eb-4f4c9698a6df req-e62a7dee-69c5-4c53-9857-9c5b0da61fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca39c53c-f52f-441d-b279-67c345389ce4", "name": "network-vif-plugged", "status": "completed", "tag": "fa747d07-5e03-4e26-8543-d0712de14cb7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:15:04.799405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-35c2a2f1-12cb-4ba1-a9eb-4f4c9698a6df req-e62a7dee-69c5-4c53-9857-9c5b0da61fd2 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:04.799871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-35c2a2f1-12cb-4ba1-a9eb-4f4c9698a6df req-e62a7dee-69c5-4c53-9857-9c5b0da61fd2 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:04.812378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-35c2a2f1-12cb-4ba1-a9eb-4f4c9698a6df req-e62a7dee-69c5-4c53-9857-9c5b0da61fd2 service nova] Creating event network-vif-plugged:fa747d07-5e03-4e26-8543-d0712de14cb7 for instance ca39c53c-f52f-441d-b279-67c345389ce4 on hv-cinder-84617 Jul 18 17:15:04.817640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-35c2a2f1-12cb-4ba1-a9eb-4f4c9698a6df req-e62a7dee-69c5-4c53-9857-9c5b0da61fd2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091276 Jul 18 17:15:04.818470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 847/1646] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:15:04.826240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bb493f60-f818-4351-b6fa-d0fc9dc968a8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:04.826240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bb493f60-f818-4351-b6fa-d0fc9dc968a8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:04.830964 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb493f60-f818-4351-b6fa-d0fc9dc968a8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:04.831417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb493f60-f818-4351-b6fa-d0fc9dc968a8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:04.832222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb493f60-f818-4351-b6fa-d0fc9dc968a8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:04.832662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb493f60-f818-4351-b6fa-d0fc9dc968a8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:04.901725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bb493f60-f818-4351-b6fa-d0fc9dc968a8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:04.910148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bb493f60-f818-4351-b6fa-d0fc9dc968a8 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.090490 Jul 18 17:15:04.910722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 848/1647] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:04 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:15:05.423368 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:05.423903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:05.430481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:05.430930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:05.431732 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:05.432178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:05.566481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:05.574380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:05.575901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:05.576994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-412a8726-d79f-454d-8e30-6a60ea001c86 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1407 microversion: 2.20 time: 0.158126 Jul 18 17:15:05.577586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 849/1648] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:15:05 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:15:05.928749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-15369af4-ace4-47ef-82c3-6212934ffc51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:05.929389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-15369af4-ace4-47ef-82c3-6212934ffc51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:05.935823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15369af4-ace4-47ef-82c3-6212934ffc51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:05.936274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15369af4-ace4-47ef-82c3-6212934ffc51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:05.937033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15369af4-ace4-47ef-82c3-6212934ffc51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:05.937466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15369af4-ace4-47ef-82c3-6212934ffc51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:05.999763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-15369af4-ace4-47ef-82c3-6212934ffc51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:06.007720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-15369af4-ace4-47ef-82c3-6212934ffc51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082818 Jul 18 17:15:06.008288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 850/1649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:05 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:06.594906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:06.595622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:06.602452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:06.602906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:06.603717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:06.604158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:06.744170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:06.752960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:06.754452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:06.755776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0a172fc4-1757-4dba-9e19-1c79e3dc09ce tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1600 microversion: 2.20 time: 0.164759 Jul 18 17:15:06.756336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 851/1650] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:15:06 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:15:06.773692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-83d21086-d3e0-4e25-b90d-08e588490cdc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:06.774181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-83d21086-d3e0-4e25-b90d-08e588490cdc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:06.780839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83d21086-d3e0-4e25-b90d-08e588490cdc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:06.781327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83d21086-d3e0-4e25-b90d-08e588490cdc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:06.782066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83d21086-d3e0-4e25-b90d-08e588490cdc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:06.782501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-83d21086-d3e0-4e25-b90d-08e588490cdc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:06.861649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-83d21086-d3e0-4e25-b90d-08e588490cdc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091743 Jul 18 17:15:06.862250 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 852/1651] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jul 18 17:15:06 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 17:15:07.025136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1e7b78a1-9455-4a77-84ce-d3238b8f742d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:07.025957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1e7b78a1-9455-4a77-84ce-d3238b8f742d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:07.033075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e7b78a1-9455-4a77-84ce-d3238b8f742d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:07.033610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e7b78a1-9455-4a77-84ce-d3238b8f742d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:07.034452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e7b78a1-9455-4a77-84ce-d3238b8f742d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:07.034954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e7b78a1-9455-4a77-84ce-d3238b8f742d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:07.127950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1e7b78a1-9455-4a77-84ce-d3238b8f742d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:07.136103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1e7b78a1-9455-4a77-84ce-d3238b8f742d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.114929 Jul 18 17:15:07.136948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 853/1652] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:07 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:07.946084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-9a55a4a0-f4a4-4e54-be63-b14e65119858 req-5aabd7cd-9ae6-475a-8380-e2f92700358b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca39c53c-f52f-441d-b279-67c345389ce4", "tag": "fa747d07-5e03-4e26-8543-d0712de14cb7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:15:07.955004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-9a55a4a0-f4a4-4e54-be63-b14e65119858 req-5aabd7cd-9ae6-475a-8380-e2f92700358b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:07.955454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-9a55a4a0-f4a4-4e54-be63-b14e65119858 req-5aabd7cd-9ae6-475a-8380-e2f92700358b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:07.966890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-9a55a4a0-f4a4-4e54-be63-b14e65119858 req-5aabd7cd-9ae6-475a-8380-e2f92700358b service nova] Creating event network-changed:fa747d07-5e03-4e26-8543-d0712de14cb7 for instance ca39c53c-f52f-441d-b279-67c345389ce4 on hv-cinder-84617 Jul 18 17:15:07.973884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-9a55a4a0-f4a4-4e54-be63-b14e65119858 req-5aabd7cd-9ae6-475a-8380-e2f92700358b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031269 Jul 18 17:15:07.974770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 854/1653] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:15:08.155305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8be4997b-1294-47b6-84a9-dbab7977d4d2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:08.156658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8be4997b-1294-47b6-84a9-dbab7977d4d2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:08.163602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8be4997b-1294-47b6-84a9-dbab7977d4d2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:08.164384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8be4997b-1294-47b6-84a9-dbab7977d4d2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:08.165272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8be4997b-1294-47b6-84a9-dbab7977d4d2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:08.165786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8be4997b-1294-47b6-84a9-dbab7977d4d2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:08.249675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8be4997b-1294-47b6-84a9-dbab7977d4d2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:08.260062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8be4997b-1294-47b6-84a9-dbab7977d4d2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.109394 Jul 18 17:15:08.261016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 855/1654] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:08 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:09.277705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d733f30c-b96e-49aa-bed7-771ccde8e9d3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:09.278354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d733f30c-b96e-49aa-bed7-771ccde8e9d3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:09.284948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d733f30c-b96e-49aa-bed7-771ccde8e9d3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:09.285400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d733f30c-b96e-49aa-bed7-771ccde8e9d3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:09.286171 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d733f30c-b96e-49aa-bed7-771ccde8e9d3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:09.286612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d733f30c-b96e-49aa-bed7-771ccde8e9d3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:09.348751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d733f30c-b96e-49aa-bed7-771ccde8e9d3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:09.356815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d733f30c-b96e-49aa-bed7-771ccde8e9d3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083362 Jul 18 17:15:09.357384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 856/1655] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:09 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:10.374617 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-056a91d0-46f5-44b0-a9c0-2dc6e16c8388 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:10.375788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-056a91d0-46f5-44b0-a9c0-2dc6e16c8388 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:10.382769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-056a91d0-46f5-44b0-a9c0-2dc6e16c8388 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:10.383216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-056a91d0-46f5-44b0-a9c0-2dc6e16c8388 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:10.384012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-056a91d0-46f5-44b0-a9c0-2dc6e16c8388 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:10.384481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-056a91d0-46f5-44b0-a9c0-2dc6e16c8388 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:10.454166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-056a91d0-46f5-44b0-a9c0-2dc6e16c8388 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:10.462277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-056a91d0-46f5-44b0-a9c0-2dc6e16c8388 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.091664 Jul 18 17:15:10.462846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 857/1656] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:10 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:11.479666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f057dfd9-3795-4881-82ef-f7216e7beb1a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:11.480382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f057dfd9-3795-4881-82ef-f7216e7beb1a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:11.487335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f057dfd9-3795-4881-82ef-f7216e7beb1a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:11.487809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f057dfd9-3795-4881-82ef-f7216e7beb1a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:11.488575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f057dfd9-3795-4881-82ef-f7216e7beb1a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:11.489005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f057dfd9-3795-4881-82ef-f7216e7beb1a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:11.549414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f057dfd9-3795-4881-82ef-f7216e7beb1a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:11.557310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f057dfd9-3795-4881-82ef-f7216e7beb1a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.081578 Jul 18 17:15:11.557866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 858/1657] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:11 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:12.575026 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ce4f8795-0cbc-4101-9bdb-90b471e69a65 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:12.575729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ce4f8795-0cbc-4101-9bdb-90b471e69a65 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:12.582761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce4f8795-0cbc-4101-9bdb-90b471e69a65 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:12.583202 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce4f8795-0cbc-4101-9bdb-90b471e69a65 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:12.583986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce4f8795-0cbc-4101-9bdb-90b471e69a65 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:12.584417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce4f8795-0cbc-4101-9bdb-90b471e69a65 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:12.650156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ce4f8795-0cbc-4101-9bdb-90b471e69a65 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:12.659312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ce4f8795-0cbc-4101-9bdb-90b471e69a65 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088129 Jul 18 17:15:12.659905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 859/1658] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:12 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:13.676889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-182dd99e-4fa5-48af-bc83-8f4dcda766a2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:13.677610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-182dd99e-4fa5-48af-bc83-8f4dcda766a2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:13.684108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-182dd99e-4fa5-48af-bc83-8f4dcda766a2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:13.684561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-182dd99e-4fa5-48af-bc83-8f4dcda766a2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:13.685322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-182dd99e-4fa5-48af-bc83-8f4dcda766a2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:13.685763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-182dd99e-4fa5-48af-bc83-8f4dcda766a2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:13.747538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-182dd99e-4fa5-48af-bc83-8f4dcda766a2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:13.756195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-182dd99e-4fa5-48af-bc83-8f4dcda766a2 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083947 Jul 18 17:15:13.756905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 860/1659] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:13 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:14.773300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9369c27e-ccf1-4d03-b44a-aef02244b353 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:14.774010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9369c27e-ccf1-4d03-b44a-aef02244b353 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:14.780497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9369c27e-ccf1-4d03-b44a-aef02244b353 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:14.780951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9369c27e-ccf1-4d03-b44a-aef02244b353 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:14.782409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9369c27e-ccf1-4d03-b44a-aef02244b353 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:14.782865 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9369c27e-ccf1-4d03-b44a-aef02244b353 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:14.844922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9369c27e-ccf1-4d03-b44a-aef02244b353 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:14.853144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9369c27e-ccf1-4d03-b44a-aef02244b353 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.083655 Jul 18 17:15:14.853684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 861/1660] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:14 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:15.870278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3a358f3e-4b7b-4988-a0cf-63b297847930 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:15.870908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3a358f3e-4b7b-4988-a0cf-63b297847930 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:15.877923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a358f3e-4b7b-4988-a0cf-63b297847930 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:15.878376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a358f3e-4b7b-4988-a0cf-63b297847930 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:15.879137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a358f3e-4b7b-4988-a0cf-63b297847930 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:15.879646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a358f3e-4b7b-4988-a0cf-63b297847930 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:15.941068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3a358f3e-4b7b-4988-a0cf-63b297847930 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:15.949044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3a358f3e-4b7b-4988-a0cf-63b297847930 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.082624 Jul 18 17:15:15.949608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 862/1661] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:15 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:16.965886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4d9be7a9-a7f8-4d07-bbe3-3749d4d45075 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:16.966500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4d9be7a9-a7f8-4d07-bbe3-3749d4d45075 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:16.973429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d9be7a9-a7f8-4d07-bbe3-3749d4d45075 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:16.973896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d9be7a9-a7f8-4d07-bbe3-3749d4d45075 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:16.974663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d9be7a9-a7f8-4d07-bbe3-3749d4d45075 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:16.975097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d9be7a9-a7f8-4d07-bbe3-3749d4d45075 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:17.043615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4d9be7a9-a7f8-4d07-bbe3-3749d4d45075 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:17.053816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4d9be7a9-a7f8-4d07-bbe3-3749d4d45075 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.091749 Jul 18 17:15:17.054381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 863/1662] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:16 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:18.071417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6e0e4334-478e-4db0-9487-de9ed7105b76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:18.072116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6e0e4334-478e-4db0-9487-de9ed7105b76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:18.078727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6e0e4334-478e-4db0-9487-de9ed7105b76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:18.079177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6e0e4334-478e-4db0-9487-de9ed7105b76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:18.079971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6e0e4334-478e-4db0-9487-de9ed7105b76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:18.080462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6e0e4334-478e-4db0-9487-de9ed7105b76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:18.154232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6e0e4334-478e-4db0-9487-de9ed7105b76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:18.163410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6e0e4334-478e-4db0-9487-de9ed7105b76 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.095824 Jul 18 17:15:18.164015 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 864/1663] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:18 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:19.182502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d7f98205-f111-4e89-8e67-b0ee824c5430 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:19.183178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d7f98205-f111-4e89-8e67-b0ee824c5430 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:19.190237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7f98205-f111-4e89-8e67-b0ee824c5430 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:19.190690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7f98205-f111-4e89-8e67-b0ee824c5430 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:19.191468 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7f98205-f111-4e89-8e67-b0ee824c5430 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:19.191935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7f98205-f111-4e89-8e67-b0ee824c5430 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:19.195095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:15:19.255749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d7f98205-f111-4e89-8e67-b0ee824c5430 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:19.263881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d7f98205-f111-4e89-8e67-b0ee824c5430 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085526 Jul 18 17:15:19.264454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 865/1664] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:19 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:20.281218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8564ed60-e2b1-48ec-af47-638e00c7f95a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:20.282389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8564ed60-e2b1-48ec-af47-638e00c7f95a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:20.289506 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8564ed60-e2b1-48ec-af47-638e00c7f95a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:20.289952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8564ed60-e2b1-48ec-af47-638e00c7f95a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:20.290725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8564ed60-e2b1-48ec-af47-638e00c7f95a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:20.291161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8564ed60-e2b1-48ec-af47-638e00c7f95a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:20.353581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8564ed60-e2b1-48ec-af47-638e00c7f95a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:20.362303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8564ed60-e2b1-48ec-af47-638e00c7f95a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084944 Jul 18 17:15:20.362878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 866/1665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:20 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:21.379694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cabdc644-54b9-43d1-937b-861d4524b4ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:21.380392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cabdc644-54b9-43d1-937b-861d4524b4ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:21.386778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cabdc644-54b9-43d1-937b-861d4524b4ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:21.387231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cabdc644-54b9-43d1-937b-861d4524b4ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:21.388023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cabdc644-54b9-43d1-937b-861d4524b4ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:21.388463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cabdc644-54b9-43d1-937b-861d4524b4ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:21.452734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cabdc644-54b9-43d1-937b-861d4524b4ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:21.461270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cabdc644-54b9-43d1-937b-861d4524b4ee tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.086097 Jul 18 17:15:21.461831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 867/1666] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:21 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:22.477694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9865ebc1-8838-4ac1-8d2b-f007419e958d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:22.478349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9865ebc1-8838-4ac1-8d2b-f007419e958d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:22.484810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9865ebc1-8838-4ac1-8d2b-f007419e958d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:22.485210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9865ebc1-8838-4ac1-8d2b-f007419e958d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:22.485977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9865ebc1-8838-4ac1-8d2b-f007419e958d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:22.486416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9865ebc1-8838-4ac1-8d2b-f007419e958d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:22.549916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9865ebc1-8838-4ac1-8d2b-f007419e958d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:22.557960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9865ebc1-8838-4ac1-8d2b-f007419e958d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.084160 Jul 18 17:15:22.558530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 868/1667] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:22 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:15:23.575501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9e6b5d0b-c582-49e0-8387-a707babc482a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:23.576167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9e6b5d0b-c582-49e0-8387-a707babc482a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:23.582998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e6b5d0b-c582-49e0-8387-a707babc482a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:23.583445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e6b5d0b-c582-49e0-8387-a707babc482a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:23.584238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e6b5d0b-c582-49e0-8387-a707babc482a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:23.584665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9e6b5d0b-c582-49e0-8387-a707babc482a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:23.649233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9e6b5d0b-c582-49e0-8387-a707babc482a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:23.660758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9e6b5d0b-c582-49e0-8387-a707babc482a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.088995 Jul 18 17:15:23.661336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 869/1668] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:23 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:24.679125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9fd93af2-cb5e-40af-90ed-dd48e67b3e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:24.680151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9fd93af2-cb5e-40af-90ed-dd48e67b3e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:24.686832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fd93af2-cb5e-40af-90ed-dd48e67b3e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:24.687272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fd93af2-cb5e-40af-90ed-dd48e67b3e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:24.688185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fd93af2-cb5e-40af-90ed-dd48e67b3e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:24.688648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fd93af2-cb5e-40af-90ed-dd48e67b3e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:24.752612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9fd93af2-cb5e-40af-90ed-dd48e67b3e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:24.760616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9fd93af2-cb5e-40af-90ed-dd48e67b3e51 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 200 len: 1369 microversion: 2.1 time: 0.085460 Jul 18 17:15:24.761186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 870/1669] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:24 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:24.776786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e2292adb-e172-4346-aabb-0c14560e89fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '.version_select at 0x7fd6ae2b7700>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:24.858716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e2292adb-e172-4346-aabb-0c14560e89fc tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792594690" status: 202 len: 0 microversion: 2.1 time: 0.085341 Jul 18 17:15:24.859306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 871/1670] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 18 17:15:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792594690 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:15:25.761062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1dc90ad2-d2ad-42ef-a4c0-9a1f62ac75f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'create', calling method: .version_select at 0x7fd6ae360ca0>, body: {"keypair": {"name": "tempest-keypair-517653365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZHPM4SHFUNOV0Pk/HNCM5yTvtf6Qe31IBFu2ytNrUEdczm9mG782ZkSzKmdXWaMnlTP3iBA0iHSsov9UIWbYjfPnDUsvCXKF9cCA8RNU0X+U0KvRwEj/dKn/bkdHJDXw=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:15:25.776609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-1dc90ad2-d2ad-42ef-a4c0-9a1f62ac75f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Getting quotas for project 9e65f14a4bef42df904a5f15befe2e16. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:15:25.780596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-1dc90ad2-d2ad-42ef-a4c0-9a1f62ac75f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Getting quotas for user c243a50903b244519ccd58f02cb798da and project 9e65f14a4bef42df904a5f15befe2e16. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:15:25.858849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1dc90ad2-d2ad-42ef-a4c0-9a1f62ac75f3 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102094 Jul 18 17:15:25.859965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 872/1671] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 17:15:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:15:28.515667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-706470147", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c914fcbf-a82f-409d-b8ef-3068a3677d9c"}], "security_groups": [{"name": "tempest-securitygroup--1335312016"}], "key_name": "tempest-keypair-517653365", "user_data": "}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:15:28.522735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:15:28.617550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] validate_networks() for [('c914fcbf-a82f-409d-b8ef-3068a3677d9c', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:15:28.993920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:15:28.994373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:15:28.994852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:15:28.995289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:15:28.995779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:15:29.005572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:29.006018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:29.006842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:29.007248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:29.025168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Getting quotas for project 9e65f14a4bef42df904a5f15befe2e16. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:15:29.029351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Getting quotas for user c243a50903b244519ccd58f02cb798da and project 9e65f14a4bef42df904a5f15befe2e16. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:15:29.041476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:15:29.043834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:15:29.212042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6a13b87e-9c70-4488-b14a-e5dd23df7657 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.701316 Jul 18 17:15:29.212700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 873/1672] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:15:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 17:15:29.227259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5873a3d0-769a-4599-8c91-f4c6173302fa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:29.227935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5873a3d0-769a-4599-8c91-f4c6173302fa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:29.291076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5873a3d0-769a-4599-8c91-f4c6173302fa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:29.299094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5873a3d0-769a-4599-8c91-f4c6173302fa tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1236 microversion: 2.1 time: 0.075712 Jul 18 17:15:29.299887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 874/1673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:29 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:30.316117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c59eb910-7df4-4c8f-868f-7e948ad0908f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:30.316811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c59eb910-7df4-4c8f-868f-7e948ad0908f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:30.324152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c59eb910-7df4-4c8f-868f-7e948ad0908f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:30.324598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c59eb910-7df4-4c8f-868f-7e948ad0908f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:30.325352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c59eb910-7df4-4c8f-868f-7e948ad0908f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:30.325787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c59eb910-7df4-4c8f-868f-7e948ad0908f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:30.395416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c59eb910-7df4-4c8f-868f-7e948ad0908f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:30.402911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c59eb910-7df4-4c8f-868f-7e948ad0908f tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1240 microversion: 2.1 time: 0.090806 Jul 18 17:15:30.403474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 875/1674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:30 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:31.420861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4c731de4-ef98-4ca6-bc1b-35e737f24556 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:31.421638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4c731de4-ef98-4ca6-bc1b-35e737f24556 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:31.428915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c731de4-ef98-4ca6-bc1b-35e737f24556 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:31.429087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c731de4-ef98-4ca6-bc1b-35e737f24556 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:31.429852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c731de4-ef98-4ca6-bc1b-35e737f24556 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:31.430292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c731de4-ef98-4ca6-bc1b-35e737f24556 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:31.503922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4c731de4-ef98-4ca6-bc1b-35e737f24556 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:31.511637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4c731de4-ef98-4ca6-bc1b-35e737f24556 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1306 microversion: 2.1 time: 0.094917 Jul 18 17:15:31.512265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 876/1675] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:31 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1306 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:32.530399 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ecf05513-1b41-431b-ad95-e63ea68a9abb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:32.533854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ecf05513-1b41-431b-ad95-e63ea68a9abb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:32.541536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecf05513-1b41-431b-ad95-e63ea68a9abb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:32.541995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecf05513-1b41-431b-ad95-e63ea68a9abb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:32.542996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecf05513-1b41-431b-ad95-e63ea68a9abb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:32.544544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecf05513-1b41-431b-ad95-e63ea68a9abb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:32.749510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ecf05513-1b41-431b-ad95-e63ea68a9abb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:32.757657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ecf05513-1b41-431b-ad95-e63ea68a9abb tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1362 microversion: 2.1 time: 0.231092 Jul 18 17:15:32.758285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 877/1676] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:32 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:32.873444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-7388315c-f2a7-4eba-8aaa-b848fcaa814f req-0691111e-ef5d-409f-b33b-26dc63ab5f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593f21f4-1ab5-48d0-8201-4bedeec9ed35", "tag": "7d12dcc1-0170-4d5f-a596-fe3502c11251"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:15:32.882514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-7388315c-f2a7-4eba-8aaa-b848fcaa814f req-0691111e-ef5d-409f-b33b-26dc63ab5f7a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:32.882953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-7388315c-f2a7-4eba-8aaa-b848fcaa814f req-0691111e-ef5d-409f-b33b-26dc63ab5f7a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:32.895815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-7388315c-f2a7-4eba-8aaa-b848fcaa814f req-0691111e-ef5d-409f-b33b-26dc63ab5f7a service nova] Creating event network-changed:7d12dcc1-0170-4d5f-a596-fe3502c11251 for instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 on hv-cinder-84617 Jul 18 17:15:32.902864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-7388315c-f2a7-4eba-8aaa-b848fcaa814f req-0691111e-ef5d-409f-b33b-26dc63ab5f7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031938 Jul 18 17:15:32.902864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 878/1677] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:15:33.775938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-02a169ae-5375-412b-858e-0e8620535d14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:33.776662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-02a169ae-5375-412b-858e-0e8620535d14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:33.782967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02a169ae-5375-412b-858e-0e8620535d14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:33.783411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02a169ae-5375-412b-858e-0e8620535d14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:33.784202 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02a169ae-5375-412b-858e-0e8620535d14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:33.784644 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02a169ae-5375-412b-858e-0e8620535d14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:33.932780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-02a169ae-5375-412b-858e-0e8620535d14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:33.941973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-02a169ae-5375-412b-858e-0e8620535d14 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1362 microversion: 2.1 time: 0.170673 Jul 18 17:15:33.942538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 879/1678] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:33 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:34.959019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3254a861-77b7-401f-ab63-7858fc133877 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:34.959746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3254a861-77b7-401f-ab63-7858fc133877 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:34.965913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3254a861-77b7-401f-ab63-7858fc133877 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:34.966367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3254a861-77b7-401f-ab63-7858fc133877 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:34.967135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3254a861-77b7-401f-ab63-7858fc133877 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:34.967599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3254a861-77b7-401f-ab63-7858fc133877 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:35.100030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3254a861-77b7-401f-ab63-7858fc133877 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:35.105857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3254a861-77b7-401f-ab63-7858fc133877 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1362 microversion: 2.1 time: 0.151098 Jul 18 17:15:35.106480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 880/1679] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:34 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:36.123462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5d76fd05-9501-41d6-b633-15363dff78a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:36.124138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5d76fd05-9501-41d6-b633-15363dff78a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:36.131426 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d76fd05-9501-41d6-b633-15363dff78a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:36.131909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d76fd05-9501-41d6-b633-15363dff78a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:36.132677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d76fd05-9501-41d6-b633-15363dff78a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:36.133117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5d76fd05-9501-41d6-b633-15363dff78a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:36.270309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5d76fd05-9501-41d6-b633-15363dff78a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:36.277769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5d76fd05-9501-41d6-b633-15363dff78a1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1362 microversion: 2.1 time: 0.158240 Jul 18 17:15:36.278332 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 881/1680] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:36 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:37.294308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ae031aed-4080-4492-9fd6-e3f883975457 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:37.295004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ae031aed-4080-4492-9fd6-e3f883975457 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:37.303964 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ae031aed-4080-4492-9fd6-e3f883975457 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:37.304419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ae031aed-4080-4492-9fd6-e3f883975457 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:37.305212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ae031aed-4080-4492-9fd6-e3f883975457 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:37.305651 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ae031aed-4080-4492-9fd6-e3f883975457 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:37.435601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ae031aed-4080-4492-9fd6-e3f883975457 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:37.443747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ae031aed-4080-4492-9fd6-e3f883975457 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1362 microversion: 2.1 time: 0.153225 Jul 18 17:15:37.444321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 882/1681] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:37 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:38.460972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fe64324b-89a3-4e54-ac43-6e4f8c26f98b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:38.461647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fe64324b-89a3-4e54-ac43-6e4f8c26f98b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:38.468034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe64324b-89a3-4e54-ac43-6e4f8c26f98b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:38.468415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe64324b-89a3-4e54-ac43-6e4f8c26f98b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:38.469191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe64324b-89a3-4e54-ac43-6e4f8c26f98b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:38.469629 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe64324b-89a3-4e54-ac43-6e4f8c26f98b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:38.604636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe64324b-89a3-4e54-ac43-6e4f8c26f98b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:38.612210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fe64324b-89a3-4e54-ac43-6e4f8c26f98b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1362 microversion: 2.1 time: 0.155542 Jul 18 17:15:38.612779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 883/1682] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:38 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:38.896842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-985b6bd4-29cf-4234-9802-b966149d977c req-842ba870-9e5c-4836-8404-397b02246fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593f21f4-1ab5-48d0-8201-4bedeec9ed35", "name": "network-vif-plugged", "status": "completed", "tag": "7d12dcc1-0170-4d5f-a596-fe3502c11251"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:15:38.905102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-985b6bd4-29cf-4234-9802-b966149d977c req-842ba870-9e5c-4836-8404-397b02246fc7 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:38.906100 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-985b6bd4-29cf-4234-9802-b966149d977c req-842ba870-9e5c-4836-8404-397b02246fc7 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:38.917998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-985b6bd4-29cf-4234-9802-b966149d977c req-842ba870-9e5c-4836-8404-397b02246fc7 service nova] Creating event network-vif-plugged:7d12dcc1-0170-4d5f-a596-fe3502c11251 for instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 on hv-cinder-84617 Jul 18 17:15:38.923646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-985b6bd4-29cf-4234-9802-b966149d977c req-842ba870-9e5c-4836-8404-397b02246fc7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031338 Jul 18 17:15:38.924242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 884/1683] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:15:39.630985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a1d9954c-99a7-4454-a702-94dde1f69833 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:39.631829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a1d9954c-99a7-4454-a702-94dde1f69833 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:39.633893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:15:39.634594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=12 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:15:39.640159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d9954c-99a7-4454-a702-94dde1f69833 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:39.640820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d9954c-99a7-4454-a702-94dde1f69833 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:39.641591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d9954c-99a7-4454-a702-94dde1f69833 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:39.642034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d9954c-99a7-4454-a702-94dde1f69833 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:39.774439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a1d9954c-99a7-4454-a702-94dde1f69833 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:39.781989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a1d9954c-99a7-4454-a702-94dde1f69833 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1362 microversion: 2.1 time: 0.156001 Jul 18 17:15:39.782558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 885/1684] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:39 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:40.799295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1f27e4d2-cf84-4c8d-8009-e8f1c1c9178d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:40.800032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1f27e4d2-cf84-4c8d-8009-e8f1c1c9178d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:40.807332 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1f27e4d2-cf84-4c8d-8009-e8f1c1c9178d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:40.807808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1f27e4d2-cf84-4c8d-8009-e8f1c1c9178d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:40.808623 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1f27e4d2-cf84-4c8d-8009-e8f1c1c9178d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:40.809109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1f27e4d2-cf84-4c8d-8009-e8f1c1c9178d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:40.949184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1f27e4d2-cf84-4c8d-8009-e8f1c1c9178d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:15:40.951430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:15:40.957382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1f27e4d2-cf84-4c8d-8009-e8f1c1c9178d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1549 microversion: 2.1 time: 0.162394 Jul 18 17:15:40.958125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 886/1685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:15:40 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:15:40.974741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-42f98f5c-c88f-497b-8ad3-7e37c4ff331d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:40.975242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-42f98f5c-c88f-497b-8ad3-7e37c4ff331d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:40.982078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-42f98f5c-c88f-497b-8ad3-7e37c4ff331d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:40.985909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-42f98f5c-c88f-497b-8ad3-7e37c4ff331d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:40.985909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-42f98f5c-c88f-497b-8ad3-7e37c4ff331d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:40.985909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-42f98f5c-c88f-497b-8ad3-7e37c4ff331d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:41.065580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-42f98f5c-c88f-497b-8ad3-7e37c4ff331d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095551 Jul 18 17:15:41.066297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 887/1686] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 18 17:15:40 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:15:42.311642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-f6f81158-b192-4bb1-bea3-1a508526d1c1 req-4853b53d-81ce-4f7d-9d02-4009d3c0a764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593f21f4-1ab5-48d0-8201-4bedeec9ed35", "tag": "7d12dcc1-0170-4d5f-a596-fe3502c11251"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:15:42.321805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f6f81158-b192-4bb1-bea3-1a508526d1c1 req-4853b53d-81ce-4f7d-9d02-4009d3c0a764 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:42.322242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f6f81158-b192-4bb1-bea3-1a508526d1c1 req-4853b53d-81ce-4f7d-9d02-4009d3c0a764 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:42.337437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-f6f81158-b192-4bb1-bea3-1a508526d1c1 req-4853b53d-81ce-4f7d-9d02-4009d3c0a764 service nova] Creating event network-changed:7d12dcc1-0170-4d5f-a596-fe3502c11251 for instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 on hv-cinder-84617 Jul 18 17:15:42.342616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-f6f81158-b192-4bb1-bea3-1a508526d1c1 req-4853b53d-81ce-4f7d-9d02-4009d3c0a764 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036052 Jul 18 17:15:42.343239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 888/1687] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:15:43.925612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8ed392fd-5cba-410d-9002-23db7317e4a4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:15:43.926319 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8ed392fd-5cba-410d-9002-23db7317e4a4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:15:43.932890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8ed392fd-5cba-410d-9002-23db7317e4a4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:43.933335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8ed392fd-5cba-410d-9002-23db7317e4a4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:43.934146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8ed392fd-5cba-410d-9002-23db7317e4a4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:15:43.934594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8ed392fd-5cba-410d-9002-23db7317e4a4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:15:43.959717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8ed392fd-5cba-410d-9002-23db7317e4a4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/ips" status: 200 len: 152 microversion: 2.20 time: 0.039117 Jul 18 17:15:43.960303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 889/1688] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jul 18 17:15:43 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 17:16:06.582466 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:16:06.583104 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:16:18.077233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2f948b35-210c-46ab-ab8f-206113edd746 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:16:18.077840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2f948b35-210c-46ab-ab8f-206113edd746 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:16:18.079926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:16:18.080569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=11 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:16:18.085422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f948b35-210c-46ab-ab8f-206113edd746 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:16:18.085869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f948b35-210c-46ab-ab8f-206113edd746 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:16:18.086632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f948b35-210c-46ab-ab8f-206113edd746 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:16:18.087121 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f948b35-210c-46ab-ab8f-206113edd746 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:16:18.110847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2f948b35-210c-46ab-ab8f-206113edd746 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/ips" status: 200 len: 147 microversion: 2.1 time: 0.037583 Jul 18 17:16:18.111674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 890/1689] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 17:16:18 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:17:34.370155 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:17:34.370622 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:17:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:17:49.971520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:17:49.972117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:17:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:18:03.868087 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:18:03.869050 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:18:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:19:26.591891 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:19:26.592729 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:20:25.888769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:20:25.889354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:20:31.570493 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR oslo.messaging._drivers.impl_rabbit [-] [338713e3-faee-430e-bab6-06d24b6ec401] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 17:20:31.576446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d46b0ade-9f24-4ecd-bbd6-7772cf9f5148 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "becb31aa-ee74-4995-8935-f57717fa8c07"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:20:31.577631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d46b0ade-9f24-4ecd-bbd6-7772cf9f5148 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:31.585388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d46b0ade-9f24-4ecd-bbd6-7772cf9f5148 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:31.587105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d46b0ade-9f24-4ecd-bbd6-7772cf9f5148 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:31.587105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d46b0ade-9f24-4ecd-bbd6-7772cf9f5148 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:31.587290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d46b0ade-9f24-4ecd-bbd6-7772cf9f5148 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:32.577816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] [338713e3-faee-430e-bab6-06d24b6ec401] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 33168. Jul 18 17:20:33.077085 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d46b0ade-9f24-4ecd-bbd6-7772cf9f5148 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.508532 Jul 18 17:20:33.077708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 891/1690] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 17:20:31 2022] POST /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments => generated 194 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:20:33.083153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-236baf87-2e61-4c09-82c0-e342a6bb3c14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:20:33.083794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-236baf87-2e61-4c09-82c0-e342a6bb3c14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:33.090917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-236baf87-2e61-4c09-82c0-e342a6bb3c14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:33.091724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-236baf87-2e61-4c09-82c0-e342a6bb3c14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:33.092163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-236baf87-2e61-4c09-82c0-e342a6bb3c14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:33.092606 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-236baf87-2e61-4c09-82c0-e342a6bb3c14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:33.117649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-236baf87-2e61-4c09-82c0-e342a6bb3c14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lazy-loading 'flavor' on Instance uuid ca39c53c-f52f-441d-b279-67c345389ce4 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:20:33.713469 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-236baf87-2e61-4c09-82c0-e342a6bb3c14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/action" status: 202 len: 0 microversion: 2.20 time: 0.634385 Jul 18 17:20:33.714342 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 892/1691] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 18 17:20:33 2022] POST /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:20:33.722569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:33.723263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:33.730419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:33.730894 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:33.731878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:33.732332 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:33.863611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:33.871867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:33.873363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:33.874522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-78c55e3a-65da-46bc-aca4-233571286d22 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.155957 Jul 18 17:20:33.875079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 893/1692] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:33 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:34.893401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:34.894012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:34.900815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:34.901268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:34.902028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:34.902467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:35.036137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:35.044692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:35.046182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:35.047339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4167a4d6-587b-490d-9480-66ebe62ceefe tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.157861 Jul 18 17:20:35.047924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 894/1693] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:34 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:36.065882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:36.066492 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:36.073722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:36.074236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:36.074964 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:36.075391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:36.205047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:36.213017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:36.216724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:36.216724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-66ae8785-fdd4-4f8d-a749-fa3405d47c0f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.153662 Jul 18 17:20:36.216724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 895/1694] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:36 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:37.234170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:37.234827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:37.241119 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:37.241564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:37.242310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:37.242746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:37.373675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:37.381608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:37.383092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:37.385009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-555fc512-b456-415f-9115-a61e0d125a8d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.154856 Jul 18 17:20:37.385555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 896/1695] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:37 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:37.535171 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-177596263", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "networks": [{"uuid": "28e22456-0921-40bd-9ae0-f99d89608f3d"}]}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:20:37.585092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] validate_networks() for [('28e22456-0921-40bd-9ae0-f99d89608f3d', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:20:37.969018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:20:37.969441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:20:37.969911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:20:37.970318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:20:37.970732 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:20:37.980673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:37.981115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:37.981919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:37.982360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:37.998827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Getting quotas for project 8368f31817254dafaea912485f3aa86b. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:20:38.002819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Getting quotas for user a9452b2e7f334f0387ecfe7194a7b38b and project 8368f31817254dafaea912485f3aa86b. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:20:38.014837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:20:38.017053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:20:38.147757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-06e721dc-00aa-4d30-8624-1ccb577b14a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616245 Jul 18 17:20:38.148455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 897/1696] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:20:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 17:20:38.158019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6e33213f-d7ee-4016-909b-33b9be88bc2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:38.158621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6e33213f-d7ee-4016-909b-33b9be88bc2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:38.212704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6e33213f-d7ee-4016-909b-33b9be88bc2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:38.220449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6e33213f-d7ee-4016-909b-33b9be88bc2b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1218 microversion: 2.1 time: 0.066041 Jul 18 17:20:38.221002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 898/1697] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:38 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:38.403301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:38.403929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:38.410724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:38.411286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:38.412080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:38.412515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:38.542289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:38.550431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:38.551960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:38.553122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e93c352a-be2e-4aed-af6c-f6e2936b6cde tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.153881 Jul 18 17:20:38.553679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 899/1698] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:38 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:39.237799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bf40cb27-aa57-4c6d-99a2-7d63f3f68ccb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:39.238447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bf40cb27-aa57-4c6d-99a2-7d63f3f68ccb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:39.244616 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf40cb27-aa57-4c6d-99a2-7d63f3f68ccb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:39.245134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf40cb27-aa57-4c6d-99a2-7d63f3f68ccb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:39.245894 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf40cb27-aa57-4c6d-99a2-7d63f3f68ccb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:39.246328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bf40cb27-aa57-4c6d-99a2-7d63f3f68ccb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:39.308246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bf40cb27-aa57-4c6d-99a2-7d63f3f68ccb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:39.315971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bf40cb27-aa57-4c6d-99a2-7d63f3f68ccb tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1222 microversion: 2.1 time: 0.081899 Jul 18 17:20:39.316611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 900/1699] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:39 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:39.572269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:39.572914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:39.579425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:39.579901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:39.580660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:39.581098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:39.712096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:39.720024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:39.721643 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:39.722826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b016937a-a1b8-4d13-9228-adbd7f0773cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.155268 Jul 18 17:20:39.723378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 901/1700] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:39 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:40.335752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ee48fa33-93c1-42bc-af4b-ec797cf07909 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:40.336451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ee48fa33-93c1-42bc-af4b-ec797cf07909 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:40.343664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ee48fa33-93c1-42bc-af4b-ec797cf07909 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:40.344110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ee48fa33-93c1-42bc-af4b-ec797cf07909 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:40.345379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ee48fa33-93c1-42bc-af4b-ec797cf07909 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:40.345509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ee48fa33-93c1-42bc-af4b-ec797cf07909 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:40.423167 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ee48fa33-93c1-42bc-af4b-ec797cf07909 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:40.431517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ee48fa33-93c1-42bc-af4b-ec797cf07909 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1276 microversion: 2.1 time: 0.099839 Jul 18 17:20:40.432088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 902/1701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:40 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:40.740697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:40.741360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:40.747879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:40.748331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:40.749099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:40.749532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:40.932945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:40.941123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:40.942653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:40.943842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2a62cb54-9eda-4590-9c44-91cb786c5fe8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.207113 Jul 18 17:20:40.944398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 903/1702] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:40 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:41.451794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-449a46b1-2989-4539-9f5e-69901f169e3c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:41.452951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-449a46b1-2989-4539-9f5e-69901f169e3c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:41.459777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-449a46b1-2989-4539-9f5e-69901f169e3c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:41.460229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-449a46b1-2989-4539-9f5e-69901f169e3c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:41.460999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-449a46b1-2989-4539-9f5e-69901f169e3c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:41.462069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-449a46b1-2989-4539-9f5e-69901f169e3c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:41.668882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-449a46b1-2989-4539-9f5e-69901f169e3c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:41.676743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-449a46b1-2989-4539-9f5e-69901f169e3c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1318 microversion: 2.1 time: 0.232058 Jul 18 17:20:41.677250 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 904/1703] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:41 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:41.962689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:41.963294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:41.970060 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:41.970505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:41.971269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:41.971743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:41.975850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:20:42.163805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:42.171735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:42.173225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:42.174627 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4f2e5295-254b-45ae-99a3-8be15db03988 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.216428 Jul 18 17:20:42.175176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 905/1704] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:41 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:42.233577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-feff6305-e399-4299-9dcf-d133495f3a83 req-b20dc17d-a4c6-416c-8ad5-cd30023fe33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5c336e1-e3d3-42bf-bd20-7d733d8874c6", "tag": "c81d5a53-0ae4-4196-9196-f6cbf277849d"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:20:42.241530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-feff6305-e399-4299-9dcf-d133495f3a83 req-b20dc17d-a4c6-416c-8ad5-cd30023fe33c service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:42.241968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-feff6305-e399-4299-9dcf-d133495f3a83 req-b20dc17d-a4c6-416c-8ad5-cd30023fe33c service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:42.252348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-feff6305-e399-4299-9dcf-d133495f3a83 req-b20dc17d-a4c6-416c-8ad5-cd30023fe33c service nova] Creating event network-changed:c81d5a53-0ae4-4196-9196-f6cbf277849d for instance c5c336e1-e3d3-42bf-bd20-7d733d8874c6 on hv-cinder-84617 Jul 18 17:20:42.257159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-feff6305-e399-4299-9dcf-d133495f3a83 req-b20dc17d-a4c6-416c-8ad5-cd30023fe33c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080892 Jul 18 17:20:42.257747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 906/1705] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:20:42.695076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d7f0be8e-fcf0-4d50-9233-68d58790314d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:42.696571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d7f0be8e-fcf0-4d50-9233-68d58790314d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:42.703043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7f0be8e-fcf0-4d50-9233-68d58790314d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:42.703486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7f0be8e-fcf0-4d50-9233-68d58790314d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:42.704287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7f0be8e-fcf0-4d50-9233-68d58790314d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:42.704719 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d7f0be8e-fcf0-4d50-9233-68d58790314d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:42.899420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d7f0be8e-fcf0-4d50-9233-68d58790314d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:42.907122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d7f0be8e-fcf0-4d50-9233-68d58790314d tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1318 microversion: 2.1 time: 0.216345 Jul 18 17:20:42.917345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 907/1706] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:42 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:43.192454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:43.193128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:43.199930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:43.201381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:43.202432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:43.202881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:43.406421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:43.414929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:43.416500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:43.417671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-59519d78-a177-49ff-8bb4-b1971eda7705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.229111 Jul 18 17:20:43.418231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 908/1707] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:43 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:43.735195 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-922fba6c-e873-44ea-9ee1-e8b348bc185c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:43.736176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-922fba6c-e873-44ea-9ee1-e8b348bc185c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:43.742204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-922fba6c-e873-44ea-9ee1-e8b348bc185c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:43.743259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-922fba6c-e873-44ea-9ee1-e8b348bc185c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:43.744052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-922fba6c-e873-44ea-9ee1-e8b348bc185c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:43.744494 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-922fba6c-e873-44ea-9ee1-e8b348bc185c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:43.773111 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-922fba6c-e873-44ea-9ee1-e8b348bc185c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042209 Jul 18 17:20:43.773697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 909/1708] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:20:43 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:20:43.782817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-82c62605-46f0-465c-96ab-51f9fae26361 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:43.783301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-82c62605-46f0-465c-96ab-51f9fae26361 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:43.788926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82c62605-46f0-465c-96ab-51f9fae26361 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:43.789922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82c62605-46f0-465c-96ab-51f9fae26361 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:43.790682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82c62605-46f0-465c-96ab-51f9fae26361 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:43.791113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-82c62605-46f0-465c-96ab-51f9fae26361 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:43.821194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-82c62605-46f0-465c-96ab-51f9fae26361 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/becb31aa-ee74-4995-8935-f57717fa8c07" status: 200 len: 194 microversion: 2.1 time: 0.041913 Jul 18 17:20:43.821763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 910/1709] 10.222.0.26 () {58 vars in 1412 bytes} [Mon Jul 18 17:20:43 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/becb31aa-ee74-4995-8935-f57717fa8c07 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:20:43.924954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-02d256b1-cb19-4fcb-a8a3-aa11ba4fec3a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:43.925495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-02d256b1-cb19-4fcb-a8a3-aa11ba4fec3a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:43.932458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02d256b1-cb19-4fcb-a8a3-aa11ba4fec3a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:43.932899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02d256b1-cb19-4fcb-a8a3-aa11ba4fec3a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:43.933657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02d256b1-cb19-4fcb-a8a3-aa11ba4fec3a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:43.934115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02d256b1-cb19-4fcb-a8a3-aa11ba4fec3a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:44.068448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-02d256b1-cb19-4fcb-a8a3-aa11ba4fec3a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:44.076103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-02d256b1-cb19-4fcb-a8a3-aa11ba4fec3a tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1318 microversion: 2.1 time: 0.155203 Jul 18 17:20:44.076670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 911/1710] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:43 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:44.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:44.436935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:44.443377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:44.443890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:44.444671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:44.445111 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:44.576895 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:44.584877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:44.587086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:44.588427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-892f8aad-2a7d-4615-8a85-6124d4feaa51 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.155998 Jul 18 17:20:44.588984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 912/1711] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:44 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:45.093142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8b8e5504-e13f-4e82-9209-cc6ab11e47ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:45.093662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8b8e5504-e13f-4e82-9209-cc6ab11e47ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:45.099729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8b8e5504-e13f-4e82-9209-cc6ab11e47ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:45.100174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8b8e5504-e13f-4e82-9209-cc6ab11e47ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:45.100926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8b8e5504-e13f-4e82-9209-cc6ab11e47ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:45.101361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8b8e5504-e13f-4e82-9209-cc6ab11e47ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:45.232641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8b8e5504-e13f-4e82-9209-cc6ab11e47ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:45.239989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8b8e5504-e13f-4e82-9209-cc6ab11e47ce tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1318 microversion: 2.1 time: 0.150815 Jul 18 17:20:45.240553 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 913/1712] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:45 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:45.338057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0fb8cf8e-53d7-4e81-b258-f604a25b088a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0507a38f-04e8-48f6-875c-3d8c18d7a06e"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:20:45.340255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0fb8cf8e-53d7-4e81-b258-f604a25b088a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:45.345119 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0fb8cf8e-53d7-4e81-b258-f604a25b088a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:45.345500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0fb8cf8e-53d7-4e81-b258-f604a25b088a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:45.346329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0fb8cf8e-53d7-4e81-b258-f604a25b088a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:45.346786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0fb8cf8e-53d7-4e81-b258-f604a25b088a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:46.000214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0fb8cf8e-53d7-4e81-b258-f604a25b088a tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "POST /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665950 Jul 18 17:20:46.000862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 914/1713] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 17:20:45 2022] POST /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:20:46.005852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:46.006532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:46.012988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:46.013436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:46.014328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:46.014637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:46.154227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:46.162544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:46.164070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:46.165650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ba0fa1fa-aba0-40fb-a9c6-3c731641d958 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.163378 Jul 18 17:20:46.166170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 915/1714] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:46 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:20:46.257644 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a92c818a-f0a5-43f0-8c00-d38eaa0f245f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:46.258768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a92c818a-f0a5-43f0-8c00-d38eaa0f245f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:46.265023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a92c818a-f0a5-43f0-8c00-d38eaa0f245f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:46.265501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a92c818a-f0a5-43f0-8c00-d38eaa0f245f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:46.266255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a92c818a-f0a5-43f0-8c00-d38eaa0f245f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:46.266694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a92c818a-f0a5-43f0-8c00-d38eaa0f245f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:46.408405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a92c818a-f0a5-43f0-8c00-d38eaa0f245f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:46.416273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a92c818a-f0a5-43f0-8c00-d38eaa0f245f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1318 microversion: 2.1 time: 0.162503 Jul 18 17:20:46.416949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 916/1715] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:46 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:47.184832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:47.185515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:47.192042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:47.192496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:47.193264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:47.193702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:47.325628 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:47.333834 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:47.335423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:47.336675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bad40707-1d4a-40af-a7e3-66d93883e132 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1745 microversion: 2.20 time: 0.156042 Jul 18 17:20:47.337242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 917/1716] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:47 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:47.434508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a692b0a0-ba0c-4007-878a-7729df56436b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:47.435140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a692b0a0-ba0c-4007-878a-7729df56436b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:47.441512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a692b0a0-ba0c-4007-878a-7729df56436b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:47.441962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a692b0a0-ba0c-4007-878a-7729df56436b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:47.442729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a692b0a0-ba0c-4007-878a-7729df56436b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:47.443165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a692b0a0-ba0c-4007-878a-7729df56436b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:47.576419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a692b0a0-ba0c-4007-878a-7729df56436b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:47.583851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a692b0a0-ba0c-4007-878a-7729df56436b tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1318 microversion: 2.1 time: 0.153736 Jul 18 17:20:47.584408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 918/1717] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:47 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:48.354226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:48.354829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:48.356866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:20:48.358022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=8 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:20:48.362856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:48.364953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:48.364953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:48.364953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:48.494302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:48.502221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:48.503746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:48.504896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-addb59e7-26b6-4c99-89f2-270adab68105 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1745 microversion: 2.20 time: 0.154588 Jul 18 17:20:48.505446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 919/1718] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:48 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:48.600336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-37749874-f22f-4e2e-8939-68a91db530a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:48.601073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37749874-f22f-4e2e-8939-68a91db530a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:48.607163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37749874-f22f-4e2e-8939-68a91db530a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:48.607647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37749874-f22f-4e2e-8939-68a91db530a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:48.608410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37749874-f22f-4e2e-8939-68a91db530a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:48.608850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37749874-f22f-4e2e-8939-68a91db530a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:48.763923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37749874-f22f-4e2e-8939-68a91db530a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:48.769365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-37749874-f22f-4e2e-8939-68a91db530a4 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1318 microversion: 2.1 time: 0.173046 Jul 18 17:20:48.769931 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 920/1719] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:48 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:20:49.052386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-086fd232-1a93-41cb-b997-8bc14ef4fa62 req-6770313d-31ec-41ff-974b-a72105395f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c336e1-e3d3-42bf-bd20-7d733d8874c6", "name": "network-vif-plugged", "status": "completed", "tag": "c81d5a53-0ae4-4196-9196-f6cbf277849d"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:20:49.061896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-086fd232-1a93-41cb-b997-8bc14ef4fa62 req-6770313d-31ec-41ff-974b-a72105395f68 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:49.062343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-086fd232-1a93-41cb-b997-8bc14ef4fa62 req-6770313d-31ec-41ff-974b-a72105395f68 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:49.066444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:20:49.074569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-086fd232-1a93-41cb-b997-8bc14ef4fa62 req-6770313d-31ec-41ff-974b-a72105395f68 service nova] Creating event network-vif-plugged:c81d5a53-0ae4-4196-9196-f6cbf277849d for instance c5c336e1-e3d3-42bf-bd20-7d733d8874c6 on hv-cinder-84617 Jul 18 17:20:49.079750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-086fd232-1a93-41cb-b997-8bc14ef4fa62 req-6770313d-31ec-41ff-974b-a72105395f68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084833 Jul 18 17:20:49.080692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 921/1720] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:20:49.526275 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:49.527074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:49.533881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:49.534335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:49.535105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:49.535571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:49.666892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:49.675208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:49.676832 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:49.677908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b8db3299-d288-4944-8883-4ea61ff7aa53 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.157789 Jul 18 17:20:49.678574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 922/1721] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:49 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:49.786095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-77b47957-5a61-4e79-ba55-d3f5df19279c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:49.786700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-77b47957-5a61-4e79-ba55-d3f5df19279c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:49.793640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77b47957-5a61-4e79-ba55-d3f5df19279c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:49.794082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77b47957-5a61-4e79-ba55-d3f5df19279c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:49.794830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77b47957-5a61-4e79-ba55-d3f5df19279c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:49.795260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77b47957-5a61-4e79-ba55-d3f5df19279c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:49.939647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-77b47957-5a61-4e79-ba55-d3f5df19279c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:49.947796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-77b47957-5a61-4e79-ba55-d3f5df19279c tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1318 microversion: 2.1 time: 0.165372 Jul 18 17:20:49.948695 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 923/1722] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:49 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:20:50.697997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:50.699428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:50.708439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:50.708893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:50.709697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:50.710330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:50.941860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:50.950796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:50.952846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:50.953507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-68d616ab-fe58-4328-8e67-079f3b1d7512 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.261134 Jul 18 17:20:50.965379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 924/1723] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:50 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:50.969133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a725efb5-89fb-4c22-a526-886b3cb44431 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:50.969739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a725efb5-89fb-4c22-a526-886b3cb44431 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:50.978672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a725efb5-89fb-4c22-a526-886b3cb44431 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:50.982971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a725efb5-89fb-4c22-a526-886b3cb44431 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:50.982971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a725efb5-89fb-4c22-a526-886b3cb44431 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:50.982971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a725efb5-89fb-4c22-a526-886b3cb44431 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:51.124032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a725efb5-89fb-4c22-a526-886b3cb44431 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:51.134497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a725efb5-89fb-4c22-a526-886b3cb44431 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1318 microversion: 2.1 time: 0.169103 Jul 18 17:20:51.135072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 925/1724] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:50 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:20:51.139584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-f5db7967-7840-4b20-8a8a-9b1bd52ff964 req-567b1f92-a16c-4862-9fe0-aad1a50f2674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca39c53c-f52f-441d-b279-67c345389ce4", "name": "network-vif-plugged", "status": "completed", "tag": "fa747d07-5e03-4e26-8543-d0712de14cb7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:20:51.148282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f5db7967-7840-4b20-8a8a-9b1bd52ff964 req-567b1f92-a16c-4862-9fe0-aad1a50f2674 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:51.150271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f5db7967-7840-4b20-8a8a-9b1bd52ff964 req-567b1f92-a16c-4862-9fe0-aad1a50f2674 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:51.161060 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-f5db7967-7840-4b20-8a8a-9b1bd52ff964 req-567b1f92-a16c-4862-9fe0-aad1a50f2674 service nova] Creating event network-vif-plugged:fa747d07-5e03-4e26-8543-d0712de14cb7 for instance ca39c53c-f52f-441d-b279-67c345389ce4 on hv-cinder-84617 Jul 18 17:20:51.167698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-f5db7967-7840-4b20-8a8a-9b1bd52ff964 req-567b1f92-a16c-4862-9fe0-aad1a50f2674 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031312 Jul 18 17:20:51.171947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 926/1725] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:20:51.975795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:51.977875 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:51.985327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:51.986021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:51.986992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:51.987418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:52.143761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:52.161393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:52.168987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:52.168987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ea663740-83d8-468a-a265-c6b5d21f9fa0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.198012 Jul 18 17:20:52.168987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 927/1726] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:51 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:52.173097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9615a766-8848-41ed-8856-9e3505c060c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:52.173836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9615a766-8848-41ed-8856-9e3505c060c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:52.185400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9615a766-8848-41ed-8856-9e3505c060c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:52.185854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9615a766-8848-41ed-8856-9e3505c060c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:52.186666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9615a766-8848-41ed-8856-9e3505c060c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:52.187104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9615a766-8848-41ed-8856-9e3505c060c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:52.345444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9615a766-8848-41ed-8856-9e3505c060c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:52.355273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9615a766-8848-41ed-8856-9e3505c060c9 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1508 microversion: 2.1 time: 0.186180 Jul 18 17:20:52.356337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 928/1727] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:20:52 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:20:52.376901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2844ee45-18b5-480d-a1e7-6b18e2fc5a3e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9c05db8-d758-4acb-b0f7-1aaf1c40a90c", "device": "/dev/sdb"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:20:52.379819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2844ee45-18b5-480d-a1e7-6b18e2fc5a3e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:52.387419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2844ee45-18b5-480d-a1e7-6b18e2fc5a3e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:52.388827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2844ee45-18b5-480d-a1e7-6b18e2fc5a3e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:52.389906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2844ee45-18b5-480d-a1e7-6b18e2fc5a3e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:52.390452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2844ee45-18b5-480d-a1e7-6b18e2fc5a3e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:53.529929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2844ee45-18b5-480d-a1e7-6b18e2fc5a3e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "POST /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.156662 Jul 18 17:20:53.535785 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 929/1728] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 17:20:52 2022] POST /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6/os-volume_attachments => generated 194 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:20:53.537092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:53.537792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:53.549589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:53.550042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:53.550819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:53.551253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:53.729676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:53.741406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:53.743033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:53.745170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-46a7755e-4d9d-463a-9c4a-0ed580bcb86f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.213210 Jul 18 17:20:53.745949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 930/1729] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:53 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:20:53.756874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-162680b8-f4a9-4df9-9382-506f5779fde9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:53.758146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-162680b8-f4a9-4df9-9382-506f5779fde9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:53.761738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:20:53.767743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-162680b8-f4a9-4df9-9382-506f5779fde9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:53.768276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-162680b8-f4a9-4df9-9382-506f5779fde9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:53.769268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-162680b8-f4a9-4df9-9382-506f5779fde9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:53.769755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-162680b8-f4a9-4df9-9382-506f5779fde9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:53.813306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-162680b8-f4a9-4df9-9382-506f5779fde9 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058810 Jul 18 17:20:53.814102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 931/1730] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:20:53 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:20:53.955014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6fb0ae5e-ead7-475d-8d6a-c3639cfd613c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:53.955341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6fb0ae5e-ead7-475d-8d6a-c3639cfd613c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:53.961407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6fb0ae5e-ead7-475d-8d6a-c3639cfd613c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:53.961969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6fb0ae5e-ead7-475d-8d6a-c3639cfd613c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:53.962637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6fb0ae5e-ead7-475d-8d6a-c3639cfd613c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:53.963080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6fb0ae5e-ead7-475d-8d6a-c3639cfd613c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:53.994611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6fb0ae5e-ead7-475d-8d6a-c3639cfd613c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/becb31aa-ee74-4995-8935-f57717fa8c07" status: 200 len: 194 microversion: 2.1 time: 0.044192 Jul 18 17:20:53.996472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 932/1731] 10.222.0.26 () {58 vars in 1412 bytes} [Mon Jul 18 17:20:53 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/becb31aa-ee74-4995-8935-f57717fa8c07 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:20:54.007158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-48359f6f-ca07-4205-9551-cfe8bd946605 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:54.007742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-48359f6f-ca07-4205-9551-cfe8bd946605 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:54.016756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48359f6f-ca07-4205-9551-cfe8bd946605 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:54.017262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48359f6f-ca07-4205-9551-cfe8bd946605 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:54.018037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48359f6f-ca07-4205-9551-cfe8bd946605 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:54.018467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48359f6f-ca07-4205-9551-cfe8bd946605 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:54.111028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-48359f6f-ca07-4205-9551-cfe8bd946605 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lazy-loading 'services' on Instance uuid 593f21f4-1ab5-48d0-8201-4bedeec9ed35 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:20:54.348513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-48359f6f-ca07-4205-9551-cfe8bd946605 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/becb31aa-ee74-4995-8935-f57717fa8c07" status: 202 len: 0 microversion: 2.1 time: 0.344930 Jul 18 17:20:54.365289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 933/1732] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 17:20:54 2022] DELETE /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/becb31aa-ee74-4995-8935-f57717fa8c07 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:20:54.378509 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:20:54.380075 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:20:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:20:54.764750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:54.765561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:54.772497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:54.773018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:54.774758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:54.775325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:54.917251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:54.926303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:54.927851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:54.929022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c7e748fe-8985-42a7-9e54-eae1a08bbc30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.168989 Jul 18 17:20:54.940397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 934/1733] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:54 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:55.952863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:55.952863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:55.955216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:55.955689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:55.956449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:55.956892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:56.094856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:56.100070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:56.102008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:56.102928 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b0b3df35-30ec-4d08-ab76-080136fa1c37 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.159574 Jul 18 17:20:56.115795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 935/1734] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:55 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:20:57.125072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:57.125711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:57.137662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:57.138496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:57.144997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:57.145584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:57.305787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:57.318920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:57.320967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:57.322249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8dc4f151-17b5-48d9-9478-d6e168facf30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.201576 Jul 18 17:20:57.322807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 936/1735] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:57 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:20:58.342897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:58.344003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:58.350639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:58.351338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:58.353138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:58.353638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:58.358040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:20:58.519674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:58.528516 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:58.530012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:58.531224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-85ce35cb-2966-4890-a0c3-5efceac3edf8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.194520 Jul 18 17:20:58.531852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 937/1736] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:58 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:20:59.552394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:20:59.553964 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:20:59.562151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:59.562673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:59.563698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:20:59.564218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:20:59.712290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:59.720828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:59.722314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:20:59.723472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-27d711ea-d6ce-48ad-b347-06629dcea7cf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.177347 Jul 18 17:20:59.727969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 938/1737] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:20:59 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:00.744289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:00.745077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:00.751474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:00.751966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:00.752758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:00.753199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:00.887944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:00.895923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:00.897417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:00.899215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d33ef88a-175e-4359-bd01-440c0099cdc4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1740 microversion: 2.20 time: 0.158535 Jul 18 17:21:00.899870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 939/1738] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:00 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:01.917996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:01.918680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:01.925438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:01.925890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:01.926667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:01.927107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:02.062503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:02.070450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:02.071992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:02.073138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6bf425df-8d64-4cd2-aed5-b2f661f445d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1722 microversion: 2.20 time: 0.159722 Jul 18 17:21:02.073700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 940/1739] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:01 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:03.092169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:03.092774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:03.098896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:03.099337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:03.100108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:03.100543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:03.233291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:03.241168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:03.242843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:03.244054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-90d488ab-178e-469b-99c7-b401be0871a7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1722 microversion: 2.20 time: 0.155781 Jul 18 17:21:03.244613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 941/1740] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:03 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:04.262485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:04.263177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:04.269871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:04.270316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:04.271062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:04.271516 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:04.404138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:04.412209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:04.413702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:04.415474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e8d09ea4-7122-4ebc-89d6-a0b6ac2c772b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1722 microversion: 2.20 time: 0.156897 Jul 18 17:21:04.416073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 942/1741] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:04 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:04.747928 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-4e95a5f1-51ad-4387-835d-d48abdf870ae req-292dd947-0cd7-4d86-9f0d-1ef7a52efeca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca39c53c-f52f-441d-b279-67c345389ce4", "name": "network-vif-unplugged", "status": "completed", "tag": "fa747d07-5e03-4e26-8543-d0712de14cb7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:21:04.755845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-4e95a5f1-51ad-4387-835d-d48abdf870ae req-292dd947-0cd7-4d86-9f0d-1ef7a52efeca service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:04.756290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-4e95a5f1-51ad-4387-835d-d48abdf870ae req-292dd947-0cd7-4d86-9f0d-1ef7a52efeca service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:04.770254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-4e95a5f1-51ad-4387-835d-d48abdf870ae req-292dd947-0cd7-4d86-9f0d-1ef7a52efeca service nova] Creating event network-vif-unplugged:fa747d07-5e03-4e26-8543-d0712de14cb7 for instance ca39c53c-f52f-441d-b279-67c345389ce4 on hv-cinder-84617 Jul 18 17:21:04.775422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-4e95a5f1-51ad-4387-835d-d48abdf870ae req-292dd947-0cd7-4d86-9f0d-1ef7a52efeca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031134 Jul 18 17:21:04.776045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 943/1742] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:21:05.435758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:05.436520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:05.442795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:05.443244 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:05.444142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:05.444575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:05.577482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:05.585833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:05.587660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:05.588913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cb03e057-3dec-45b4-b404-f3fa6b63937f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1722 microversion: 2.20 time: 0.158072 Jul 18 17:21:05.589601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 944/1743] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:05 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:06.076457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e33a6ce8-07eb-441c-9bc7-04486fc5ea32 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:06.076952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e33a6ce8-07eb-441c-9bc7-04486fc5ea32 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:06.082883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e33a6ce8-07eb-441c-9bc7-04486fc5ea32 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:06.087350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e33a6ce8-07eb-441c-9bc7-04486fc5ea32 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:06.087350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e33a6ce8-07eb-441c-9bc7-04486fc5ea32 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:06.087350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e33a6ce8-07eb-441c-9bc7-04486fc5ea32 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:06.113035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e33a6ce8-07eb-441c-9bc7-04486fc5ea32 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/0507a38f-04e8-48f6-875c-3d8c18d7a06e" status: 200 len: 194 microversion: 2.1 time: 0.040450 Jul 18 17:21:06.118086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 945/1744] 10.222.0.26 () {58 vars in 1412 bytes} [Mon Jul 18 17:21:06 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/0507a38f-04e8-48f6-875c-3d8c18d7a06e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:21:06.123637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-37ee0a48-9478-47c3-8a31-7c5edb99f481 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:06.124122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37ee0a48-9478-47c3-8a31-7c5edb99f481 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:06.129765 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ee0a48-9478-47c3-8a31-7c5edb99f481 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:06.130213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ee0a48-9478-47c3-8a31-7c5edb99f481 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:06.130981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ee0a48-9478-47c3-8a31-7c5edb99f481 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:06.131420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ee0a48-9478-47c3-8a31-7c5edb99f481 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:06.211381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-37ee0a48-9478-47c3-8a31-7c5edb99f481 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lazy-loading 'services' on Instance uuid 593f21f4-1ab5-48d0-8201-4bedeec9ed35 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:21:06.452857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-37ee0a48-9478-47c3-8a31-7c5edb99f481 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/0507a38f-04e8-48f6-875c-3d8c18d7a06e" status: 202 len: 0 microversion: 2.1 time: 0.332559 Jul 18 17:21:06.453475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 946/1745] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 17:21:06 2022] DELETE /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments/0507a38f-04e8-48f6-875c-3d8c18d7a06e => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:21:06.611916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:06.612561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:06.619482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:06.619955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:06.620715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:06.621160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:06.749541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:06.757576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:06.759286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:06.760472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-74e13d33-5f6c-4914-9c22-9848f6b3d802 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1665 microversion: 2.20 time: 0.152967 Jul 18 17:21:06.761036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 947/1746] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:06 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:06.777911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-40d08945-257f-4672-843e-f5eb630f520f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5573dd7-cbc6-4b30-8a45-34402fb6b12f"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:21:06.779017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-40d08945-257f-4672-843e-f5eb630f520f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:06.784733 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40d08945-257f-4672-843e-f5eb630f520f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:06.785184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40d08945-257f-4672-843e-f5eb630f520f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:06.785941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40d08945-257f-4672-843e-f5eb630f520f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:06.786378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-40d08945-257f-4672-843e-f5eb630f520f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:07.755816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-40d08945-257f-4672-843e-f5eb630f520f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.981457 Jul 18 17:21:07.756513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 948/1747] 10.222.0.26 () {62 vars in 1363 bytes} [Mon Jul 18 17:21:06 2022] POST /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments => generated 188 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 17:21:07.870711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-97a6230c-f27b-4a85-b3c5-5312558abcd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:21:07.871304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-97a6230c-f27b-4a85-b3c5-5312558abcd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:07.878102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97a6230c-f27b-4a85-b3c5-5312558abcd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:07.878550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97a6230c-f27b-4a85-b3c5-5312558abcd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:07.879337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97a6230c-f27b-4a85-b3c5-5312558abcd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:07.879801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97a6230c-f27b-4a85-b3c5-5312558abcd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:08.107293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-97a6230c-f27b-4a85-b3c5-5312558abcd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/action" status: 202 len: 0 microversion: 2.20 time: 0.240122 Jul 18 17:21:08.107986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 949/1748] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 18 17:21:07 2022] POST /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:21:08.115619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:08.116204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:08.122877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:08.123317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:08.124102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:08.124533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:08.128774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:21:08.262289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:08.271000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:08.272534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:08.274055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b304b576-332e-4381-9531-9e1d239f742f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1751 microversion: 2.20 time: 0.162011 Jul 18 17:21:08.274621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 950/1749] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:08 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:09.292445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:09.293302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:09.300512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:09.302340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:09.302340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:09.302340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:09.435971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:09.444619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:09.450181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:09.450181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7f5ee30b-4db9-48eb-aaaa-d7424747420c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1751 microversion: 2.20 time: 0.160020 Jul 18 17:21:09.450181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 951/1750] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:09 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:10.467214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:10.467968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:10.475013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:10.475537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:10.476936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:10.477402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:10.609453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:10.618376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:10.619883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:10.621025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8bb803cf-0df9-47b4-8daf-4007c13472f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1753 microversion: 2.20 time: 0.157972 Jul 18 17:21:10.621574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 952/1751] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:10 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:10.788149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4d169406-bf10-410c-a27c-0d1819fa007b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:10.789189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4d169406-bf10-410c-a27c-0d1819fa007b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:10.795604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d169406-bf10-410c-a27c-0d1819fa007b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:10.796052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d169406-bf10-410c-a27c-0d1819fa007b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:10.796842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d169406-bf10-410c-a27c-0d1819fa007b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:10.797282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4d169406-bf10-410c-a27c-0d1819fa007b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:10.826525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4d169406-bf10-410c-a27c-0d1819fa007b tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042566 Jul 18 17:21:10.827343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 953/1752] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:21:10 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 17:21:10.933777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7bfa8e28-4a02-4bea-b7f8-0f021ceb7f50 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:10.934727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7bfa8e28-4a02-4bea-b7f8-0f021ceb7f50 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:10.940756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bfa8e28-4a02-4bea-b7f8-0f021ceb7f50 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:10.941199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bfa8e28-4a02-4bea-b7f8-0f021ceb7f50 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:10.941957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bfa8e28-4a02-4bea-b7f8-0f021ceb7f50 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:10.942387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bfa8e28-4a02-4bea-b7f8-0f021ceb7f50 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:10.972114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7bfa8e28-4a02-4bea-b7f8-0f021ceb7f50 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042457 Jul 18 17:21:10.972669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 954/1753] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:21:10 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 17:21:11.029776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f05b6e4c-632f-443f-9ff6-f771ae9f8d2c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:11.030300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f05b6e4c-632f-443f-9ff6-f771ae9f8d2c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:11.036417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f05b6e4c-632f-443f-9ff6-f771ae9f8d2c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:11.036869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f05b6e4c-632f-443f-9ff6-f771ae9f8d2c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:11.037639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f05b6e4c-632f-443f-9ff6-f771ae9f8d2c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:11.038076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f05b6e4c-632f-443f-9ff6-f771ae9f8d2c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:11.063851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f05b6e4c-632f-443f-9ff6-f771ae9f8d2c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:21:11.364170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f05b6e4c-632f-443f-9ff6-f771ae9f8d2c tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 204 len: 0 microversion: 2.1 time: 0.337927 Jul 18 17:21:11.364774 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 955/1754] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:21:11 2022] DELETE /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:21:11.373713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-69b6e4e5-820f-41d3-9999-fde2af436ac0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:11.374391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-69b6e4e5-820f-41d3-9999-fde2af436ac0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:11.380260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69b6e4e5-820f-41d3-9999-fde2af436ac0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:11.380701 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69b6e4e5-820f-41d3-9999-fde2af436ac0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:11.381447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69b6e4e5-820f-41d3-9999-fde2af436ac0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:11.381872 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69b6e4e5-820f-41d3-9999-fde2af436ac0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:11.578003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69b6e4e5-820f-41d3-9999-fde2af436ac0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:11.585725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-69b6e4e5-820f-41d3-9999-fde2af436ac0 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1674 microversion: 2.1 time: 0.215863 Jul 18 17:21:11.586683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 956/1755] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:11 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:11.640033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:11.640630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:11.646502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:11.646946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:11.647729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:11.648247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:11.779221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:11.787531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:11.789694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:11.790836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-24c33f5a-6a64-4db5-b2fd-8f79b5c16494 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.155009 Jul 18 17:21:11.791387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 957/1756] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:11 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:12.603990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-63581469-ccd9-4a24-b65c-c6ca99d3772d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:12.604649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-63581469-ccd9-4a24-b65c-c6ca99d3772d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:12.611658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63581469-ccd9-4a24-b65c-c6ca99d3772d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:12.612113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63581469-ccd9-4a24-b65c-c6ca99d3772d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:12.612886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63581469-ccd9-4a24-b65c-c6ca99d3772d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:12.613519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-63581469-ccd9-4a24-b65c-c6ca99d3772d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:12.770115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-63581469-ccd9-4a24-b65c-c6ca99d3772d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:12.778027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-63581469-ccd9-4a24-b65c-c6ca99d3772d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1674 microversion: 2.1 time: 0.178383 Jul 18 17:21:12.778588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 958/1757] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:12 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:12.810798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:12.811735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:12.821630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:12.821630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:12.822005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:12.828756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:12.968210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:12.977908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:12.979700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:12.981140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7b831bd7-d60e-4f59-a690-69280cca5747 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.174716 Jul 18 17:21:12.981931 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 959/1758] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:12 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:21:13.518504 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c7bb0686-d1c1-440f-9e2a-09c8b956f411 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:13.518997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c7bb0686-d1c1-440f-9e2a-09c8b956f411 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:13.526752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7bb0686-d1c1-440f-9e2a-09c8b956f411 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:13.527344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7bb0686-d1c1-440f-9e2a-09c8b956f411 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:13.528434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7bb0686-d1c1-440f-9e2a-09c8b956f411 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:13.528947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7bb0686-d1c1-440f-9e2a-09c8b956f411 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:13.677203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-c7bb0686-d1c1-440f-9e2a-09c8b956f411 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lazy-loading 'services' on Instance uuid c5c336e1-e3d3-42bf-bd20-7d733d8874c6 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:21:13.966250 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c7bb0686-d1c1-440f-9e2a-09c8b956f411 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6/os-volume_attachments/c9c05db8-d758-4acb-b0f7-1aaf1c40a90c" status: 202 len: 0 microversion: 2.1 time: 0.451515 Jul 18 17:21:13.967730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 960/1759] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 17:21:13 2022] DELETE /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6/os-volume_attachments/c9c05db8-d758-4acb-b0f7-1aaf1c40a90c => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:21:13.975165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4652a9cb-c73e-4897-8d5d-4b91c98de548 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:13.976792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4652a9cb-c73e-4897-8d5d-4b91c98de548 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:13.984859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4652a9cb-c73e-4897-8d5d-4b91c98de548 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:13.985821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4652a9cb-c73e-4897-8d5d-4b91c98de548 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:13.986972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4652a9cb-c73e-4897-8d5d-4b91c98de548 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:13.987741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4652a9cb-c73e-4897-8d5d-4b91c98de548 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:14.072476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4652a9cb-c73e-4897-8d5d-4b91c98de548 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:14.082084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4652a9cb-c73e-4897-8d5d-4b91c98de548 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.112367 Jul 18 17:21:14.083540 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 961/1760] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:13 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:21:14.176527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-c665e09a-8270-4ced-9be1-5c496cffb770 req-2bcee7b5-3ea8-45d0-8062-07660169132d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593f21f4-1ab5-48d0-8201-4bedeec9ed35", "name": "network-vif-deleted", "tag": "7d12dcc1-0170-4d5f-a596-fe3502c11251"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:21:14.186470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-c665e09a-8270-4ced-9be1-5c496cffb770 req-2bcee7b5-3ea8-45d0-8062-07660169132d service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:14.188331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-c665e09a-8270-4ced-9be1-5c496cffb770 req-2bcee7b5-3ea8-45d0-8062-07660169132d service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:14.200393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-c665e09a-8270-4ced-9be1-5c496cffb770 req-2bcee7b5-3ea8-45d0-8062-07660169132d service nova] Creating event network-vif-deleted:7d12dcc1-0170-4d5f-a596-fe3502c11251 for instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 on hv-cinder-84617 Jul 18 17:21:14.207799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-c665e09a-8270-4ced-9be1-5c496cffb770 req-2bcee7b5-3ea8-45d0-8062-07660169132d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123444 Jul 18 17:21:14.208821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 962/1761] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:21:14.217548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:14.218365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:14.225314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:14.225836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:14.226924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:14.227633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:14.380282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:14.391161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:14.392697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:14.393848 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ff48f2f9-8ee7-4fe2-98a1-689e96ccb017 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.180415 Jul 18 17:21:14.394591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 963/1762] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:14 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:21:15.099281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5199f901-bc30-4c8c-89d9-70c0c7d785cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:15.099923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5199f901-bc30-4c8c-89d9-70c0c7d785cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:15.106991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5199f901-bc30-4c8c-89d9-70c0c7d785cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:15.112841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5199f901-bc30-4c8c-89d9-70c0c7d785cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:15.112841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5199f901-bc30-4c8c-89d9-70c0c7d785cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:15.112841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5199f901-bc30-4c8c-89d9-70c0c7d785cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:15.181710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5199f901-bc30-4c8c-89d9-70c0c7d785cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:15.189804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5199f901-bc30-4c8c-89d9-70c0c7d785cd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.094301 Jul 18 17:21:15.190381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 964/1763] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:15 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:15.412184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:15.412704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:15.419055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:15.419519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:15.420334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:15.420772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:15.425193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:21:15.561084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:15.570624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:15.572348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:15.573528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4c1514bd-c288-477c-aef9-4a90acfe0902 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.165313 Jul 18 17:21:15.574279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 965/1764] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:15 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:16.215931 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6c905145-15ab-4e6f-aa3f-6dfb8ec88119 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:16.216612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6c905145-15ab-4e6f-aa3f-6dfb8ec88119 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:16.222514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c905145-15ab-4e6f-aa3f-6dfb8ec88119 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:16.222953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c905145-15ab-4e6f-aa3f-6dfb8ec88119 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:16.223742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c905145-15ab-4e6f-aa3f-6dfb8ec88119 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:16.224175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c905145-15ab-4e6f-aa3f-6dfb8ec88119 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:16.286850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6c905145-15ab-4e6f-aa3f-6dfb8ec88119 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:16.294445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6c905145-15ab-4e6f-aa3f-6dfb8ec88119 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.084280 Jul 18 17:21:16.295012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 966/1765] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:16 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:16.592320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:16.592842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:16.598746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:16.599211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:16.599984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:16.600416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:16.746215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:16.755168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:16.758123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:16.759324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c09d9ee8-1612-49df-8ad1-c3df1e7a76f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.171028 Jul 18 17:21:16.760142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 967/1766] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:16 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:17.312305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-aefecedf-330d-49b9-9110-613c1987ff45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:17.312966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-aefecedf-330d-49b9-9110-613c1987ff45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:17.321154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aefecedf-330d-49b9-9110-613c1987ff45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:17.321599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aefecedf-330d-49b9-9110-613c1987ff45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:17.322745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aefecedf-330d-49b9-9110-613c1987ff45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:17.323184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-aefecedf-330d-49b9-9110-613c1987ff45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:17.397871 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-aefecedf-330d-49b9-9110-613c1987ff45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:17.406114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-aefecedf-330d-49b9-9110-613c1987ff45 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.097540 Jul 18 17:21:17.406692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 968/1767] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:17 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:17.778479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:17.779077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:17.785542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:17.785994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:17.786764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:17.787205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:17.938960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:17.948221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:17.949890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:17.951096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-47684244-dbcc-46a3-a473-b93a1de9d5e8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.176572 Jul 18 17:21:17.951772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 969/1768] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:17 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:18.424948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3589b018-8c0c-4346-a070-08a4e2164cbf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:18.426400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3589b018-8c0c-4346-a070-08a4e2164cbf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:18.434391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3589b018-8c0c-4346-a070-08a4e2164cbf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:18.435596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3589b018-8c0c-4346-a070-08a4e2164cbf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:18.436470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3589b018-8c0c-4346-a070-08a4e2164cbf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:18.436983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3589b018-8c0c-4346-a070-08a4e2164cbf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:18.503767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3589b018-8c0c-4346-a070-08a4e2164cbf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:18.512314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3589b018-8c0c-4346-a070-08a4e2164cbf tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.091928 Jul 18 17:21:18.513222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 970/1769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:18 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:18.970370 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:18.971002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:18.977681 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:18.978133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:18.978901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:18.979340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:19.130646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:19.138921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:19.140588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:19.141727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-04acebee-b1c1-4397-a2ee-689f6894ae0b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.175385 Jul 18 17:21:19.142271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 971/1770] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:18 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:19.530381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0cda75c4-2958-4474-8a66-fcc7b58758e7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:19.531219 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0cda75c4-2958-4474-8a66-fcc7b58758e7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:19.537792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cda75c4-2958-4474-8a66-fcc7b58758e7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:19.538242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cda75c4-2958-4474-8a66-fcc7b58758e7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:19.539645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cda75c4-2958-4474-8a66-fcc7b58758e7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:19.540296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cda75c4-2958-4474-8a66-fcc7b58758e7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:19.605214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0cda75c4-2958-4474-8a66-fcc7b58758e7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:19.612831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0cda75c4-2958-4474-8a66-fcc7b58758e7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.086267 Jul 18 17:21:19.613392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 972/1771] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:19 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:20.162240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:20.162840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:20.171183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:20.171661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:20.172462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:20.172897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:20.304621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:20.313080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:20.314667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:20.316083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f4ffd4ad-b3d3-411f-a09e-2f4595c2d25d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.158997 Jul 18 17:21:20.316829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 973/1772] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:20 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:21:20.630700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8a93e843-ffa8-47a4-a4cc-3d387e0873bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:20.631515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8a93e843-ffa8-47a4-a4cc-3d387e0873bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:20.638452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8a93e843-ffa8-47a4-a4cc-3d387e0873bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:20.638905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8a93e843-ffa8-47a4-a4cc-3d387e0873bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:20.639695 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8a93e843-ffa8-47a4-a4cc-3d387e0873bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:20.640128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8a93e843-ffa8-47a4-a4cc-3d387e0873bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:20.710243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8a93e843-ffa8-47a4-a4cc-3d387e0873bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:20.717933 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8a93e843-ffa8-47a4-a4cc-3d387e0873bd tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.091159 Jul 18 17:21:20.718495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 974/1773] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:20 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:21.337152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:21.337741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:21.343837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:21.344322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:21.345080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:21.345504 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:21.729332 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:21.737656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:21.739141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:21.740430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c3cbdc64-1df4-4c71-85fa-37f55d8748c2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.407777 Jul 18 17:21:21.740988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 975/1774] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:21 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:21.745921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d41a7cec-7a97-4963-91f0-fd1a47fd8bb6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:21.746691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d41a7cec-7a97-4963-91f0-fd1a47fd8bb6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:21.753368 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d41a7cec-7a97-4963-91f0-fd1a47fd8bb6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:21.753822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d41a7cec-7a97-4963-91f0-fd1a47fd8bb6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:21.754921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d41a7cec-7a97-4963-91f0-fd1a47fd8bb6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:21.755409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d41a7cec-7a97-4963-91f0-fd1a47fd8bb6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:21.852642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d41a7cec-7a97-4963-91f0-fd1a47fd8bb6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:21.860416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d41a7cec-7a97-4963-91f0-fd1a47fd8bb6 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.118351 Jul 18 17:21:21.866634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 976/1775] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:21 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:21:22.759367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:22.760277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:22.763860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:21:22.768004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:22.768497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:22.769272 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:22.769742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:22.924995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:22.934675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:22.936701 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:22.938007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0d4ee1d1-df6c-4b35-aea0-7f00e80821dd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.182722 Jul 18 17:21:22.943576 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 977/1776] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:22 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:22.958449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2776d228-dfda-4620-9d4f-2e5fa2195802 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:22.959872 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2776d228-dfda-4620-9d4f-2e5fa2195802 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:22.969373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2776d228-dfda-4620-9d4f-2e5fa2195802 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:22.970181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2776d228-dfda-4620-9d4f-2e5fa2195802 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:22.971290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2776d228-dfda-4620-9d4f-2e5fa2195802 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:22.971988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2776d228-dfda-4620-9d4f-2e5fa2195802 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:23.041984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2776d228-dfda-4620-9d4f-2e5fa2195802 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:23.050096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2776d228-dfda-4620-9d4f-2e5fa2195802 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.105137 Jul 18 17:21:23.050854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 978/1777] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:22 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:21:23.876196 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:21:23.876678 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:21:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:21:23.960759 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:23.961385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:23.967897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:23.968349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:23.969222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:23.969663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:24.099852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:24.108628 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:24.110128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:24.111286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-926e567e-5b56-4f48-804d-db81079e6b30 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.154486 Jul 18 17:21:24.111885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 979/1778] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:23 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:24.116175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3def1092-2a94-4797-b2ab-be62b02d52a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:24.117387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3def1092-2a94-4797-b2ab-be62b02d52a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:24.123285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3def1092-2a94-4797-b2ab-be62b02d52a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:24.123769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3def1092-2a94-4797-b2ab-be62b02d52a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:24.124533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3def1092-2a94-4797-b2ab-be62b02d52a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:24.124975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3def1092-2a94-4797-b2ab-be62b02d52a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:24.188621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3def1092-2a94-4797-b2ab-be62b02d52a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:24.196294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3def1092-2a94-4797-b2ab-be62b02d52a5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1606 microversion: 2.1 time: 0.083480 Jul 18 17:21:24.196857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 980/1779] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:24 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1606 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:21:25.130259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:25.130945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:25.137801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:25.138246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:25.139002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:25.139437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:25.267689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:25.271087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:21:25.277093 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:25.278591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:25.279768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a582e44e-3794-490a-902c-99bb28470658 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.153466 Jul 18 17:21:25.283086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 981/1780] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:25 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:25.284867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:25.285455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:25.292014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:25.292475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:25.293228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:25.293660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:25.325002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:25.325442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:25.325878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lazy-loading 'fault' on Instance uuid 593f21f4-1ab5-48d0-8201-4bedeec9ed35 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:21:25.368840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c243a50903b244519ccd58f02cb798da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e65f14a4bef42df904a5f15befe2e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:25.376522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9ac13025-0ef2-4222-a565-e7d0511dbcb1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 200 len: 1326 microversion: 2.1 time: 0.095174 Jul 18 17:21:25.384435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 982/1781] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:25 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:21:26.297986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:26.298666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:26.305915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:26.306356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:26.307107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:26.307579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:26.439848 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:26.448939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:26.450413 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:26.451582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f18003fb-d2f8-4342-ba78-551e535fb608 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.157539 Jul 18 17:21:26.452134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 983/1782] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:26 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:26.456441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:26.457027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:26.463216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:26.463708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:26.464448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:26.464877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:26.477897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] HTTP exception thrown: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Request method failure captured: Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 HTTP/1.1 Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y5NIxgZ_lJYfP0hamSN64A2Aqmk5nS3TSNqBtu_JKjNm_XqQ3aM9Y2Xj-TfTyWMQM0du5VGvEn8eir7gfe8SE14ewvNUrdgsqmn2xDM46Ht3VyGT8DtYGxUAjhg9TTZaRCVYyuWjm_Wdpdc-mNGrBwr-dJN_RZLr1HubPdHemm9YQ8 Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:21:26.479517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e65f14a4bef42df904a5f15befe2e16", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}] Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: c243a50903b244519ccd58f02cb798da Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:26.481297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '593f21f4-1ab5-48d0-8201-4bedeec9ed35'} Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:21:26.482354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:26.484109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:26.485589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Returning 404 to user: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:21:26.485589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d59319e8-0673-44db-bba8-d34e96bf432e tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 404 len: 111 microversion: 2.1 time: 0.027822 Jul 18 17:21:26.485589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 984/1783] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:26 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:21:26.489389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-453634bf-b128-42e7-a036-36bbadc14e3d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '.version_select at 0x7fd6ae0ff040>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:26.559221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-453634bf-b128-42e7-a036-36bbadc14e3d tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-517653365" status: 202 len: 0 microversion: 2.1 time: 0.073225 Jul 18 17:21:26.559748 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 985/1784] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 18 17:21:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-517653365 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:21:26.790684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-67e63c03-ff67-482d-83d4-d7563af4b202 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:26.791209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-67e63c03-ff67-482d-83d4-d7563af4b202 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:26.799777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67e63c03-ff67-482d-83d4-d7563af4b202 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:26.800289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67e63c03-ff67-482d-83d4-d7563af4b202 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:26.801118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67e63c03-ff67-482d-83d4-d7563af4b202 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:26.801457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67e63c03-ff67-482d-83d4-d7563af4b202 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:26.835211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-67e63c03-ff67-482d-83d4-d7563af4b202 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:21:27.102172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-67e63c03-ff67-482d-83d4-d7563af4b202 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 204 len: 0 microversion: 2.1 time: 0.315967 Jul 18 17:21:27.102668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 986/1785] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:21:26 2022] DELETE /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:21:27.110988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1a4274ab-52c7-4aa0-9e5f-5803c7716ec2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:27.111692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1a4274ab-52c7-4aa0-9e5f-5803c7716ec2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:27.117717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a4274ab-52c7-4aa0-9e5f-5803c7716ec2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:27.118162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a4274ab-52c7-4aa0-9e5f-5803c7716ec2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:27.118937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a4274ab-52c7-4aa0-9e5f-5803c7716ec2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:27.119370 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1a4274ab-52c7-4aa0-9e5f-5803c7716ec2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:27.317258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1a4274ab-52c7-4aa0-9e5f-5803c7716ec2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:27.325614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1a4274ab-52c7-4aa0-9e5f-5803c7716ec2 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1514 microversion: 2.1 time: 0.218665 Jul 18 17:21:27.327423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 987/1786] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:27 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:27.470170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:27.470790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:27.476937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:27.477382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:27.478192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:27.478638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:27.613304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:27.627269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:27.628838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:27.630040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7a968ffd-269e-4ea9-9455-7c4dc0cb2856 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.163714 Jul 18 17:21:27.630581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 988/1787] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:27 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:28.342979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5bb524ab-49b2-43e2-82eb-577d489a27e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:28.343654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5bb524ab-49b2-43e2-82eb-577d489a27e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:28.350054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bb524ab-49b2-43e2-82eb-577d489a27e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:28.350509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bb524ab-49b2-43e2-82eb-577d489a27e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:28.351963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bb524ab-49b2-43e2-82eb-577d489a27e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:28.352591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bb524ab-49b2-43e2-82eb-577d489a27e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:28.479409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5bb524ab-49b2-43e2-82eb-577d489a27e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:28.487137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5bb524ab-49b2-43e2-82eb-577d489a27e8 tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1514 microversion: 2.1 time: 0.148121 Jul 18 17:21:28.487728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 989/1788] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:28 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:28.656609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:28.658354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:28.665214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:28.665735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:28.666509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:28.666944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:28.801864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:28.810514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:28.812039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:28.813206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1380f5fb-9950-4735-8612-648702bf0072 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.161551 Jul 18 17:21:28.813755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 990/1789] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:28 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:21:29.282356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-3874518d-5726-400f-8093-5e9a7b04171a req-2480c1ef-70f1-4673-a4bd-1452ced63430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5c336e1-e3d3-42bf-bd20-7d733d8874c6", "name": "network-vif-deleted", "tag": "c81d5a53-0ae4-4196-9196-f6cbf277849d"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:21:29.291913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-3874518d-5726-400f-8093-5e9a7b04171a req-2480c1ef-70f1-4673-a4bd-1452ced63430 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:29.292360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-3874518d-5726-400f-8093-5e9a7b04171a req-2480c1ef-70f1-4673-a4bd-1452ced63430 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:29.303711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-3874518d-5726-400f-8093-5e9a7b04171a req-2480c1ef-70f1-4673-a4bd-1452ced63430 service nova] Creating event network-vif-deleted:c81d5a53-0ae4-4196-9196-f6cbf277849d for instance c5c336e1-e3d3-42bf-bd20-7d733d8874c6 on hv-cinder-84617 Jul 18 17:21:29.309811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-3874518d-5726-400f-8093-5e9a7b04171a req-2480c1ef-70f1-4673-a4bd-1452ced63430 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031327 Jul 18 17:21:29.310392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 991/1790] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:21:29.504955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4ec99106-b93d-4fa5-8788-7b8a7fdcc38f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:29.506878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4ec99106-b93d-4fa5-8788-7b8a7fdcc38f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:29.512963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ec99106-b93d-4fa5-8788-7b8a7fdcc38f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:29.513463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ec99106-b93d-4fa5-8788-7b8a7fdcc38f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:29.514234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ec99106-b93d-4fa5-8788-7b8a7fdcc38f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:29.514667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4ec99106-b93d-4fa5-8788-7b8a7fdcc38f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:29.583884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4ec99106-b93d-4fa5-8788-7b8a7fdcc38f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9452b2e7f334f0387ecfe7194a7b38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8368f31817254dafaea912485f3aa86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:29.592430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4ec99106-b93d-4fa5-8788-7b8a7fdcc38f tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 200 len: 1303 microversion: 2.1 time: 0.091656 Jul 18 17:21:29.593060 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 992/1791] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:29 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:21:29.839736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:29.840368 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:29.846376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:29.846815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:29.847597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:29.848036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:29.977336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:29.985736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:29.987226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:29.988403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f1cafd42-b568-4517-a581-c0fdd9040694 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.154142 Jul 18 17:21:29.988956 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 993/1792] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:29 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:21:29.994052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:29.994523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:30.000519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:30.000982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:30.001731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:30.002173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:30.016559 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] HTTP exception thrown: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Request method failure captured: Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 HTTP/1.1 Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y5NIxgZ_lJYfP0hamSN64A2Aqmk5nS3TSNqBtu_JKjNm_XqQ3aM9Y2Xj-TfTyWMQM0du5VGvEn8eir7gfe8SE14ewvNUrdgsqmn2xDM46Ht3VyGT8DtYGxUAjhg9TTZaRCVYyuWjm_Wdpdc-mNGrBwr-dJN_RZLr1HubPdHemm9YQ8 Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:21:30.018218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e65f14a4bef42df904a5f15befe2e16", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}] Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: c243a50903b244519ccd58f02cb798da Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.019844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '593f21f4-1ab5-48d0-8201-4bedeec9ed35'} Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:21:30.020829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.022396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.024160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Returning 404 to user: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:21:30.024160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-db06e767-bb34-4254-bc67-b47a9c43d3c5 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 404 len: 111 microversion: 2.1 time: 0.029723 Jul 18 17:21:30.024160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 994/1793] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:21:29 2022] DELETE /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:21:30.027849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:30.028449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 593f21f4-1ab5-48d0-8201-4bedeec9ed35] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:30.034240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:30.034685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:30.035440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:30.035900 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:30.048820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] HTTP exception thrown: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Request method failure captured: Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 HTTP/1.1 Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y5NIxgZ_lJYfP0hamSN64A2Aqmk5nS3TSNqBtu_JKjNm_XqQ3aM9Y2Xj-TfTyWMQM0du5VGvEn8eir7gfe8SE14ewvNUrdgsqmn2xDM46Ht3VyGT8DtYGxUAjhg9TTZaRCVYyuWjm_Wdpdc-mNGrBwr-dJN_RZLr1HubPdHemm9YQ8 Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:21:30.055822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e65f14a4bef42df904a5f15befe2e16", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}] Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: c243a50903b244519ccd58f02cb798da Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.057740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '593f21f4-1ab5-48d0-8201-4bedeec9ed35'} Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:21:30.058706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. Jul 18 17:21:30.060260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.062352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Returning 404 to user: Instance 593f21f4-1ab5-48d0-8201-4bedeec9ed35 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:21:30.062352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-68cb2883-2122-4dfb-baf0-87970d74ddd1 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35" status: 404 len: 111 microversion: 2.1 time: 0.027579 Jul 18 17:21:30.062352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 995/1794] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:30 2022] GET /compute/v2.1/servers/593f21f4-1ab5-48d0-8201-4bedeec9ed35 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:21:30.614237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:30.614933 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] [instance: c5c336e1-e3d3-42bf-bd20-7d733d8874c6] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:30.623614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:30.629019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:30.629019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:30.629019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:30.640116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] HTTP exception thrown: Instance c5c336e1-e3d3-42bf-bd20-7d733d8874c6 could not be found. Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Request method failure captured: Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 HTTP/1.1 Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y7cBe60M8ibbUWQXfIgXfC_znmsA2xIYH5QWtH9SnqjdGB3ly02B4enRqhVJr9CiL5YKT1CtqfOKmIygZlpeIPMuv-pyW_cnpFUWTSCJbpWaDIw--vBqYUfmPyydL1FxFWaqink2N-v91-uDUichqcH49_KP3bD19kG6ve0W6gHpC4 Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 8368f31817254dafaea912485f3aa86b Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:21:30.641772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8368f31817254dafaea912485f3aa86b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8368f31817254dafaea912485f3aa86b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8368f31817254dafaea912485f3aa86b"}]}] Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 8368f31817254dafaea912485f3aa86b Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1515575951 Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a9452b2e7f334f0387ecfe7194a7b38b Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-VolumesSnapshotTestJSON-1515575951-project Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance c5c336e1-e3d3-42bf-bd20-7d733d8874c6 could not be found. Jul 18 17:21:30.643462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'c5c336e1-e3d3-42bf-bd20-7d733d8874c6'} Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5c336e1-e3d3-42bf-bd20-7d733d8874c6 could not be found. Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:21:30.644656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5c336e1-e3d3-42bf-bd20-7d733d8874c6 could not be found. Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5c336e1-e3d3-42bf-bd20-7d733d8874c6 could not be found. Jul 18 17:21:30.646307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:21:30.648317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] Returning 404 to user: Instance c5c336e1-e3d3-42bf-bd20-7d733d8874c6 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:21:30.648317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ccd6c856-909b-477d-b97e-8a7a61bfac5e tempest-VolumesSnapshotTestJSON-1515575951 tempest-VolumesSnapshotTestJSON-1515575951-project] 10.222.0.26 "GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6" status: 404 len: 111 microversion: 2.1 time: 0.032904 Jul 18 17:21:30.648317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 996/1795] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:21:30 2022] GET /compute/v2.1/servers/c5c336e1-e3d3-42bf-bd20-7d733d8874c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:21:31.007477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:31.008360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:31.014969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:31.015462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:31.016251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:31.016698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:31.156280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:31.166489 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:31.168082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:31.169227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1c196ca2-efd3-4496-a369-b005cf7c4811 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.165835 Jul 18 17:21:31.170583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 997/1796] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:31 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:32.188924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:32.189531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:32.196656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:32.197096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:32.197850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:32.198280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:32.334945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:32.343417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:32.344934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:32.346069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-529775fe-c4a1-4e01-ab48-9303e65bf183 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.161122 Jul 18 17:21:32.346625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 998/1797] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:32 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:33.364325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:33.364932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:33.371664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:33.372110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:33.372861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:33.373295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:33.500022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:33.508892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:33.510380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:33.511547 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f7e44e6a-d740-4031-b927-98bc337bded9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.151186 Jul 18 17:21:33.512097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 999/1798] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:33 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:21:34.529896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:34.530525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:34.537001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:34.537451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:34.538205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:34.539415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:34.671641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:34.675439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:21:34.680748 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:34.682210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:34.687799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-639151b4-6d3b-4416-9828-a59d0c7c93b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.157330 Jul 18 17:21:34.687799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1000/1799] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:34 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:35.704921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:35.705518 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:35.712825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:35.713270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:35.714029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:35.714470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:35.849287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:35.858462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:35.859984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:35.861182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4a17580e-69a9-41ae-8793-f32b89f6938b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.160147 Jul 18 17:21:35.861736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1001/1800] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:35 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:36.878462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:36.879065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:36.886575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:36.887025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:36.887823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:36.888265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:37.020912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:37.029362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:37.033216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:37.033216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-52207d2e-bfed-451e-9e9e-28184fcdc783 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.157493 Jul 18 17:21:37.033216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1002/1801] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:36 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:37.834444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-0c9fdfdd-5bef-4b75-9a43-d9638b84919d req-7ef8a905-2ecd-42f5-a8dc-68b9f7a1cb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca39c53c-f52f-441d-b279-67c345389ce4", "name": "network-vif-plugged", "status": "completed", "tag": "fa747d07-5e03-4e26-8543-d0712de14cb7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:21:37.844300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-0c9fdfdd-5bef-4b75-9a43-d9638b84919d req-7ef8a905-2ecd-42f5-a8dc-68b9f7a1cb9b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:37.849525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-0c9fdfdd-5bef-4b75-9a43-d9638b84919d req-7ef8a905-2ecd-42f5-a8dc-68b9f7a1cb9b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:37.855758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-0c9fdfdd-5bef-4b75-9a43-d9638b84919d req-7ef8a905-2ecd-42f5-a8dc-68b9f7a1cb9b service nova] Creating event network-vif-plugged:fa747d07-5e03-4e26-8543-d0712de14cb7 for instance ca39c53c-f52f-441d-b279-67c345389ce4 on hv-cinder-84617 Jul 18 17:21:37.860881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-0c9fdfdd-5bef-4b75-9a43-d9638b84919d req-7ef8a905-2ecd-42f5-a8dc-68b9f7a1cb9b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030605 Jul 18 17:21:37.861493 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1003/1802] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:21:38.052457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:38.053069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:38.060758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:38.061210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:38.062082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:38.062523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:38.193788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:38.203079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:38.204617 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:38.205761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0c5bfce8-d436-4793-b58c-df8fdeac3a5f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.157957 Jul 18 17:21:38.206317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1004/1803] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:38 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:39.224412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:39.225050 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:39.233944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:39.234384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:39.235248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:39.235707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:39.367018 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:39.375330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:39.376852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:39.377988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d98d18ff-f3fe-4944-afdd-92c899ba6484 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.157601 Jul 18 17:21:39.378545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1005/1804] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:39 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:40.396260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:40.396918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:40.404174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:40.404626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:40.405427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:40.405867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:40.539279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:40.547943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:40.549714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:40.550864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-066d2184-eb62-4ecf-8394-6c0ba249500c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1809 microversion: 2.20 time: 0.158561 Jul 18 17:21:40.551415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1006/1805] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:40 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:21:41.569786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:21:41.570524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:21:41.577077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:41.577565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:41.578323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:21:41.578760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:21:41.714252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:41.728278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:41.729972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:21:41.731143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-85a3f024-75b5-42c9-963d-0dfdcca989ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1796 microversion: 2.20 time: 0.165241 Jul 18 17:21:41.732051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1007/1806] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:21:41 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1796 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:13.305853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3d6b60df-e658-498d-9e1f-ab41cca6d28f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:13.308143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3d6b60df-e658-498d-9e1f-ab41cca6d28f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:13.314522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:13.315353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=38 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:13.319196 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d6b60df-e658-498d-9e1f-ab41cca6d28f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:13.319882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d6b60df-e658-498d-9e1f-ab41cca6d28f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:13.320853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d6b60df-e658-498d-9e1f-ab41cca6d28f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:13.321512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d6b60df-e658-498d-9e1f-ab41cca6d28f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:13.362396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3d6b60df-e658-498d-9e1f-ab41cca6d28f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments/d5573dd7-cbc6-4b30-8a45-34402fb6b12f" status: 200 len: 194 microversion: 2.20 time: 0.061378 Jul 18 17:22:13.363748 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1008/1807] 10.222.0.26 () {60 vars in 1453 bytes} [Mon Jul 18 17:22:13 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments/d5573dd7-cbc6-4b30-8a45-34402fb6b12f => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 17:22:13.454123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fb1ced03-a9d9-4a2f-a4bd-e947a0fce1bb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:13.454821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fb1ced03-a9d9-4a2f-a4bd-e947a0fce1bb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:13.462551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb1ced03-a9d9-4a2f-a4bd-e947a0fce1bb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:13.463364 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb1ced03-a9d9-4a2f-a4bd-e947a0fce1bb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:13.465389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb1ced03-a9d9-4a2f-a4bd-e947a0fce1bb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:13.466322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb1ced03-a9d9-4a2f-a4bd-e947a0fce1bb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:13.560289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-fb1ced03-a9d9-4a2f-a4bd-e947a0fce1bb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lazy-loading 'services' on Instance uuid ca39c53c-f52f-441d-b279-67c345389ce4 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:22:13.851131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fb1ced03-a9d9-4a2f-a4bd-e947a0fce1bb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments/d5573dd7-cbc6-4b30-8a45-34402fb6b12f" status: 202 len: 0 microversion: 2.20 time: 0.400879 Jul 18 17:22:13.852047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1009/1808] 10.222.0.26 () {60 vars in 1456 bytes} [Mon Jul 18 17:22:13 2022] DELETE /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments/d5573dd7-cbc6-4b30-8a45-34402fb6b12f => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:22:13.862056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0d6a3476-c612-4792-9f48-4c90dca8b7bd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:13.863631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0d6a3476-c612-4792-9f48-4c90dca8b7bd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:13.873677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d6a3476-c612-4792-9f48-4c90dca8b7bd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:13.874434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d6a3476-c612-4792-9f48-4c90dca8b7bd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:13.875509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d6a3476-c612-4792-9f48-4c90dca8b7bd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:13.876133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d6a3476-c612-4792-9f48-4c90dca8b7bd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:13.924347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0d6a3476-c612-4792-9f48-4c90dca8b7bd tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066736 Jul 18 17:22:13.925691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1010/1809] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 18 17:22:13 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 17:22:14.939590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6c95043b-1118-43c8-939a-9ec5a22622a3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:14.940522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6c95043b-1118-43c8-939a-9ec5a22622a3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:14.948220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c95043b-1118-43c8-939a-9ec5a22622a3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:14.948806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c95043b-1118-43c8-939a-9ec5a22622a3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:14.949772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c95043b-1118-43c8-939a-9ec5a22622a3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:14.950375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6c95043b-1118-43c8-939a-9ec5a22622a3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:14.987323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6c95043b-1118-43c8-939a-9ec5a22622a3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054691 Jul 18 17:22:14.988564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1011/1810] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 18 17:22:14 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:15.058372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-960b2ed3-3f2b-4df6-90a8-41c2ffe75878 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:15.058868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-960b2ed3-3f2b-4df6-90a8-41c2ffe75878 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:15.068663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-960b2ed3-3f2b-4df6-90a8-41c2ffe75878 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:15.069308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-960b2ed3-3f2b-4df6-90a8-41c2ffe75878 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:15.070342 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-960b2ed3-3f2b-4df6-90a8-41c2ffe75878 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:15.070939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-960b2ed3-3f2b-4df6-90a8-41c2ffe75878 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:15.105330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-960b2ed3-3f2b-4df6-90a8-41c2ffe75878 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:22:15.450410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-960b2ed3-3f2b-4df6-90a8-41c2ffe75878 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 204 len: 0 microversion: 2.20 time: 0.396760 Jul 18 17:22:15.451010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1012/1811] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 18 17:22:15 2022] DELETE /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 17:22:15.464192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:15.465209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:15.511930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:15.512394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:15.513192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:15.513635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:15.676582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:15.686048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:15.688039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:15.689399 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cb568879-3484-4274-a971-622d02740905 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.230137 Jul 18 17:22:15.690047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1013/1812] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:15 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:22:16.709420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:16.710112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:16.718917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:16.719607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:16.720380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:16.720998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:16.892021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:16.900403 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:16.903618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:16.905121 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9f05ffc8-c7d6-458e-ad2c-35e11c95acf0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1724 microversion: 2.20 time: 0.199554 Jul 18 17:22:16.905987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1014/1813] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:16 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:17.924531 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:17.926197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:17.951277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:17.951757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:17.952540 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:17.953187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:18.054274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:18.066639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:18.070873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:18.070873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-98289274-ade9-44b3-a33f-46cb38a93584 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 200 len: 1657 microversion: 2.20 time: 0.149911 Jul 18 17:22:18.070873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1015/1814] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:17 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 1657 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:18.090458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-10f500ed-5c39-4bf2-98f4-65bb171a2362 req-9540a7e7-22e3-4be3-8d69-88b0cf5cc460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca39c53c-f52f-441d-b279-67c345389ce4", "name": "network-vif-deleted", "tag": "fa747d07-5e03-4e26-8543-d0712de14cb7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:18.108721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-10f500ed-5c39-4bf2-98f4-65bb171a2362 req-9540a7e7-22e3-4be3-8d69-88b0cf5cc460 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:18.109463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-10f500ed-5c39-4bf2-98f4-65bb171a2362 req-9540a7e7-22e3-4be3-8d69-88b0cf5cc460 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:18.126076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-10f500ed-5c39-4bf2-98f4-65bb171a2362 req-9540a7e7-22e3-4be3-8d69-88b0cf5cc460 service nova] Creating event network-vif-deleted:fa747d07-5e03-4e26-8543-d0712de14cb7 for instance ca39c53c-f52f-441d-b279-67c345389ce4 on hv-cinder-84617 Jul 18 17:22:18.132186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-10f500ed-5c39-4bf2-98f4-65bb171a2362 req-9540a7e7-22e3-4be3-8d69-88b0cf5cc460 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059986 Jul 18 17:22:18.133686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1016/1815] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:22:19.090817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:19.091592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:19.103161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:19.103641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:19.105263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:19.105715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:19.125833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] HTTP exception thrown: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Request method failure captured: Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 HTTP/1.1 Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1ZULWQSjXdKtHDWk4NRZaFpOSF5vjIuo6OpqbGDie83TnfOo1yd0-GenbQK9yDtakehP1M3jhBvIYOAo-6fEL7elJY1ANWeth-mgSW7HATwVD3ek3KhONJ3yen5Bsvdu4J0YAdTNMVqX0vU2QHedRtTVtyE2TowWOKAhQJyDTiIIQc0 Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:22:19.127563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1bad1610198d4b8aacfafc8c92dc7e6d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}] Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 9aec7436e3a549018fd7892969870019 Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:22:19.130582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'ca39c53c-f52f-441d-b279-67c345389ce4'} Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:22:19.131562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:22:19.133003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:22:19.134398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Returning 404 to user: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:22:19.134398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f9b53936-9aa3-4643-951e-aef6457b4d32 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 404 len: 111 microversion: 2.20 time: 0.043733 Jul 18 17:22:19.134398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1017/1816] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:19 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 17:22:19.141308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b54eb657-e66e-4324-a5db-c4eca0865c59 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '.version_select at 0x7fd6ae2ee310>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:19.496118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b54eb657-e66e-4324-a5db-c4eca0865c59 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030415902" status: 204 len: 0 microversion: 2.20 time: 0.359692 Jul 18 17:22:19.496747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1018/1817] 10.222.0.26 () {60 vars in 1261 bytes} [Mon Jul 18 17:22:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030415902 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 17:22:20.381844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3984de4d-21f6-4fd7-b658-9839c801cb84 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'create', calling method: .version_select at 0x7fd6ae0b5820>, body: {"keypair": {"name": "tempest-keypair-1227968768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGQuBUiPn3qQa4dii2XUW3nusopebyYnoEdraXCAZ8ldMvwecQRzI4GfBVHh3fI+ZBYx3zDNJosJe6Ss6DC5Og+FljQ9kjvY8CzLaMq5IvEJPO6//mg0eRocKaeVMSbAA=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:20.410636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-3984de4d-21f6-4fd7-b658-9839c801cb84 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Getting quotas for project 1bad1610198d4b8aacfafc8c92dc7e6d. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:22:20.414771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-3984de4d-21f6-4fd7-b658-9839c801cb84 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Getting quotas for user 9aec7436e3a549018fd7892969870019 and project 1bad1610198d4b8aacfafc8c92dc7e6d. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:22:20.491448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3984de4d-21f6-4fd7-b658-9839c801cb84 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.113586 Jul 18 17:22:20.492471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1019/1818] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jul 18 17:22:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 17:22:23.040013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-764619765", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e121000a-b4be-43f5-8f4d-03170f01894f"}], "security_groups": [{"name": "tempest-securitygroup--1476490794"}], "key_name": "tempest-keypair-1227968768", "user_data": "}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:23.159642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] validate_networks() for [('e121000a-b4be-43f5-8f4d-03170f01894f', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:22:23.838383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:22:23.838503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:22:23.838976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:22:23.839384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:22:23.839849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:22:23.850295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:23.850738 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:23.851570 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:23.852007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:23.869104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Getting quotas for project 1bad1610198d4b8aacfafc8c92dc7e6d. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:22:23.873590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Getting quotas for user 9aec7436e3a549018fd7892969870019 and project 1bad1610198d4b8aacfafc8c92dc7e6d. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:22:23.884474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:22:23.887471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:22:23.994277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0b57a4cd-242d-4527-a3dd-311b35b6716c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.958372 Jul 18 17:22:23.995650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1020/1819] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jul 18 17:22:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 17:22:24.008718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-aaad0c72-23f8-4688-bcaa-6671b118c86a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:24.009543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-aaad0c72-23f8-4688-bcaa-6671b118c86a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:24.066743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-aaad0c72-23f8-4688-bcaa-6671b118c86a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:24.074255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-aaad0c72-23f8-4688-bcaa-6671b118c86a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:24.075811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-aaad0c72-23f8-4688-bcaa-6671b118c86a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:24.076905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-aaad0c72-23f8-4688-bcaa-6671b118c86a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1281 microversion: 2.20 time: 0.074210 Jul 18 17:22:24.077486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1021/1820] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:24 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:24.081842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f9954f84-4db5-4daa-ace5-32db2322ce29 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Action: 'create', calling method: .version_select at 0x7fd6adfbaa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1824475531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRsfg/k1tjERCf3XAK515WL2N3dsM+4+dvIZz8CtOKRUeBQMknJybI3QkE9fAEDDsxFosDX/al7LYGhMxE9Gqix8E7SUDVraUx2jTVF4wWl4I9OT4PmMjffJlx3kBNprg=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:24.096617 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-f9954f84-4db5-4daa-ace5-32db2322ce29 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Getting quotas for project 0d565c1992f5420fa5166d2cfb6f1ab2. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:22:24.100656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-f9954f84-4db5-4daa-ace5-32db2322ce29 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Getting quotas for user a6ebcad94c6048c8b174cfcee63a15a7 and project 0d565c1992f5420fa5166d2cfb6f1ab2. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:22:24.313718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f9954f84-4db5-4daa-ace5-32db2322ce29 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.235159 Jul 18 17:22:24.317459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1022/1821] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 17:22:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:22:24.365730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-689919597", "imageRef": "1b7a88d1-4538-48ac-993f-058beab2bfcd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1824475531", "networks": [{"uuid": "9a5e8fdf-8276-4468-92df-7fbd335d65d0"}]}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:24.416635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] validate_networks() for [('9a5e8fdf-8276-4468-92df-7fbd335d65d0', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:22:24.794431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:22:24.794849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:22:24.795355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:22:24.795786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:22:24.796197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:22:24.805115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:24.805565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:24.806358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:24.806795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:24.824266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Getting quotas for project 0d565c1992f5420fa5166d2cfb6f1ab2. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:22:24.828082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Getting quotas for user a6ebcad94c6048c8b174cfcee63a15a7 and project 0d565c1992f5420fa5166d2cfb6f1ab2. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:22:24.839203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:22:24.841345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b7a88d1-4538-48ac-993f-058beab2bfcd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:22:24.985934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0ef1c92b-79e6-4964-ab3e-e77c426c4774 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624598 Jul 18 17:22:24.986706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1023/1822] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:22:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:22:24.997390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b2419d17-167b-40bc-aadd-c5303b8db231 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:24.999770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b2419d17-167b-40bc-aadd-c5303b8db231 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:25.052135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b2419d17-167b-40bc-aadd-c5303b8db231 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:25.060027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b2419d17-167b-40bc-aadd-c5303b8db231 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1258 microversion: 2.1 time: 0.067276 Jul 18 17:22:25.060601 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1024/1823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:24 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:25.097712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:25.097712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:25.099074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=8 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:25.103231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:25.103711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:25.104520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:25.105024 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:25.169711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:25.182850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:25.182850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:25.182850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c32cb562-0060-480b-a09a-b55718893812 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1285 microversion: 2.20 time: 0.090448 Jul 18 17:22:25.183286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1025/1824] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:25 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:26.077457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1cee931d-a010-4de0-a105-5df3ccd8d07a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:26.078059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1cee931d-a010-4de0-a105-5df3ccd8d07a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:26.140640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1cee931d-a010-4de0-a105-5df3ccd8d07a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:26.147763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1cee931d-a010-4de0-a105-5df3ccd8d07a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1258 microversion: 2.1 time: 0.074425 Jul 18 17:22:26.148334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1026/1825] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:26 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:22:26.200588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:26.222838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:26.229782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:26.230067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:26.230842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:26.231758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:26.302231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:26.310921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:26.312441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:26.313554 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-de6a9a4b-504e-46cf-9360-71434f9e24b1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1351 microversion: 2.20 time: 0.118108 Jul 18 17:22:26.314104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1027/1826] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:26 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:27.165845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-be28f56d-cae9-4967-86b1-08a3a45c7e37 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:27.166564 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-be28f56d-cae9-4967-86b1-08a3a45c7e37 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:27.174137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-be28f56d-cae9-4967-86b1-08a3a45c7e37 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:27.178269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-be28f56d-cae9-4967-86b1-08a3a45c7e37 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:27.178269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-be28f56d-cae9-4967-86b1-08a3a45c7e37 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:27.178269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-be28f56d-cae9-4967-86b1-08a3a45c7e37 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:27.239068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-be28f56d-cae9-4967-86b1-08a3a45c7e37 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:27.246610 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-be28f56d-cae9-4967-86b1-08a3a45c7e37 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1310 microversion: 2.1 time: 0.084957 Jul 18 17:22:27.247168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1028/1827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:27 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:27.337175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:27.337808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:27.345752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:27.346202 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:27.347001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:27.347431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:27.598621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:27.607294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:27.608827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:27.609936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f195d56a-2d7a-49ff-a362-d23f243b09e4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.276799 Jul 18 17:22:27.619797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1029/1828] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:27 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:22:27.983706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-2598a792-0af2-4c20-92ff-d97ef39c4c27 req-0df287c3-cc52-42a4-b709-d450455513b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132383c1-3fc0-4d92-a338-48eda2dd1592", "tag": "163ac153-2186-439d-ac74-66a80aeff440"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:27.996301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-2598a792-0af2-4c20-92ff-d97ef39c4c27 req-0df287c3-cc52-42a4-b709-d450455513b5 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:27.996766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-2598a792-0af2-4c20-92ff-d97ef39c4c27 req-0df287c3-cc52-42a4-b709-d450455513b5 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:28.011854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-2598a792-0af2-4c20-92ff-d97ef39c4c27 req-0df287c3-cc52-42a4-b709-d450455513b5 service nova] Creating event network-changed:163ac153-2186-439d-ac74-66a80aeff440 for instance 132383c1-3fc0-4d92-a338-48eda2dd1592 on hv-cinder-84617 Jul 18 17:22:28.016289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-2598a792-0af2-4c20-92ff-d97ef39c4c27 req-0df287c3-cc52-42a4-b709-d450455513b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041282 Jul 18 17:22:28.016957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1030/1829] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:22:28.270398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0a18772f-950a-4764-9c6e-a2038157ec06 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:28.271955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0a18772f-950a-4764-9c6e-a2038157ec06 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:28.287396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a18772f-950a-4764-9c6e-a2038157ec06 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:28.292193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a18772f-950a-4764-9c6e-a2038157ec06 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:28.292193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a18772f-950a-4764-9c6e-a2038157ec06 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:28.292193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0a18772f-950a-4764-9c6e-a2038157ec06 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:28.343302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:28.567505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0a18772f-950a-4764-9c6e-a2038157ec06 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:28.589094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0a18772f-950a-4764-9c6e-a2038157ec06 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.320596 Jul 18 17:22:28.589094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1031/1830] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:28 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:22:28.628072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:28.630064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:28.642050 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:28.644091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:28.645161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:28.646285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:28.938582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:28.954683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:28.956606 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:28.957979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7d01d614-a253-4b6e-aa4a-43a697612480 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.333761 Jul 18 17:22:28.969084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1032/1831] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:28 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:29.621631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a2d02eb4-332b-4c84-a251-4b2123bc9869 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:29.622333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a2d02eb4-332b-4c84-a251-4b2123bc9869 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:29.639747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a2d02eb4-332b-4c84-a251-4b2123bc9869 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:29.640478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a2d02eb4-332b-4c84-a251-4b2123bc9869 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:29.641432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a2d02eb4-332b-4c84-a251-4b2123bc9869 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:29.642153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a2d02eb4-332b-4c84-a251-4b2123bc9869 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:29.856133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a2d02eb4-332b-4c84-a251-4b2123bc9869 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:29.869656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a2d02eb4-332b-4c84-a251-4b2123bc9869 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.261445 Jul 18 17:22:29.870226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1033/1832] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:29 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:22:29.882201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-fdd4df80-fb07-4020-980c-8cc2d69404ab req-fe1ec4f0-5b97-4191-a9e3-dbaf199712b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e4933a-4b2e-4f87-ac28-1de0ece7e8f4", "tag": "6e07037e-4e55-43ac-b4c3-5cdb6509ac0c"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:29.896201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-fdd4df80-fb07-4020-980c-8cc2d69404ab req-fe1ec4f0-5b97-4191-a9e3-dbaf199712b1 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:29.896982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-fdd4df80-fb07-4020-980c-8cc2d69404ab req-fe1ec4f0-5b97-4191-a9e3-dbaf199712b1 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:29.911956 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-fdd4df80-fb07-4020-980c-8cc2d69404ab req-fe1ec4f0-5b97-4191-a9e3-dbaf199712b1 service nova] Creating event network-changed:6e07037e-4e55-43ac-b4c3-5cdb6509ac0c for instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 on hv-cinder-84617 Jul 18 17:22:29.916849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-fdd4df80-fb07-4020-980c-8cc2d69404ab req-fe1ec4f0-5b97-4191-a9e3-dbaf199712b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038477 Jul 18 17:22:29.921439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1034/1833] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:22:29.976586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:29.977618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:29.985581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:29.986749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:29.987973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:29.988481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:30.138322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:30.147988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:30.149684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:30.150850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c8a5435e-9e9c-44af-ad49-b7a306b71ccb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.178525 Jul 18 17:22:30.151543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1035/1834] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:29 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:30.888549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-584de935-5996-4518-9009-5e1c9ad3335f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:30.890594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-584de935-5996-4518-9009-5e1c9ad3335f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:30.897664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584de935-5996-4518-9009-5e1c9ad3335f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:30.898105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584de935-5996-4518-9009-5e1c9ad3335f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:30.898863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584de935-5996-4518-9009-5e1c9ad3335f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:30.899295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-584de935-5996-4518-9009-5e1c9ad3335f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:31.038330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-584de935-5996-4518-9009-5e1c9ad3335f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:31.046957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-584de935-5996-4518-9009-5e1c9ad3335f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.164333 Jul 18 17:22:31.056574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1036/1835] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:30 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:31.171204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:31.172080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:31.179264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:31.179997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:31.180957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:31.181566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:31.320182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:31.330015 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:31.333034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:31.335913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fe169704-cc9b-48fc-9487-147502e43f08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.170009 Jul 18 17:22:31.336724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1037/1836] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:31 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:32.064443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-16971e74-a44c-418f-a08e-b9a92ba67ff4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:32.066015 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-16971e74-a44c-418f-a08e-b9a92ba67ff4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:32.073358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-16971e74-a44c-418f-a08e-b9a92ba67ff4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:32.074709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-16971e74-a44c-418f-a08e-b9a92ba67ff4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:32.075981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-16971e74-a44c-418f-a08e-b9a92ba67ff4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:32.076620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-16971e74-a44c-418f-a08e-b9a92ba67ff4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:32.220624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-16971e74-a44c-418f-a08e-b9a92ba67ff4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:32.232561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-16971e74-a44c-418f-a08e-b9a92ba67ff4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.171798 Jul 18 17:22:32.233150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1038/1837] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:32 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:22:32.356962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:32.357662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:32.365510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:32.366055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:32.366941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:32.367434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:32.513797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:32.522075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:32.523587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:32.524688 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-45b2567a-155b-4a58-8325-dc8538c9ee1b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.172680 Jul 18 17:22:32.525240 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1039/1838] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:32 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:33.250266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7faceb8d-d67b-43ce-8f3d-ad19b5b5aa1e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:33.250979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7faceb8d-d67b-43ce-8f3d-ad19b5b5aa1e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:33.257241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7faceb8d-d67b-43ce-8f3d-ad19b5b5aa1e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:33.257689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7faceb8d-d67b-43ce-8f3d-ad19b5b5aa1e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:33.258515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7faceb8d-d67b-43ce-8f3d-ad19b5b5aa1e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:33.258946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7faceb8d-d67b-43ce-8f3d-ad19b5b5aa1e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:33.406640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7faceb8d-d67b-43ce-8f3d-ad19b5b5aa1e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:33.416291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7faceb8d-d67b-43ce-8f3d-ad19b5b5aa1e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.170406 Jul 18 17:22:33.416902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1040/1839] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:33 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:33.544333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:33.544986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:33.551602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:33.552059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:33.552864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:33.553310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:33.692249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:33.701384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:33.703216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:33.704367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8e1ca82e-2291-4d8b-84b0-1d07a67c37e2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.164954 Jul 18 17:22:33.705131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1041/1840] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:33 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:34.436425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-69019a70-a9ad-42ca-8cf1-4122e74c7954 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:34.437069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-69019a70-a9ad-42ca-8cf1-4122e74c7954 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:34.443789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69019a70-a9ad-42ca-8cf1-4122e74c7954 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:34.444243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69019a70-a9ad-42ca-8cf1-4122e74c7954 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:34.445021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69019a70-a9ad-42ca-8cf1-4122e74c7954 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:34.445452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69019a70-a9ad-42ca-8cf1-4122e74c7954 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:34.597114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69019a70-a9ad-42ca-8cf1-4122e74c7954 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:34.604159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-69019a70-a9ad-42ca-8cf1-4122e74c7954 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.172861 Jul 18 17:22:34.604758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1042/1841] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:34 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:34.722366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:34.723243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:34.734637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:34.735092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:34.736111 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:34.736644 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:34.816034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:34.898544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:34.909213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:34.911206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:34.912597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ed8fcc8c-b938-4088-9fff-d4604770bb14 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.194231 Jul 18 17:22:34.913740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1043/1842] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:34 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:22:35.624308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c9c4222c-2bf0-4919-a7ad-a5176fcd2b98 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:35.625081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c9c4222c-2bf0-4919-a7ad-a5176fcd2b98 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:35.632162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9c4222c-2bf0-4919-a7ad-a5176fcd2b98 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:35.632619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9c4222c-2bf0-4919-a7ad-a5176fcd2b98 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:35.633386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9c4222c-2bf0-4919-a7ad-a5176fcd2b98 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:35.633828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c9c4222c-2bf0-4919-a7ad-a5176fcd2b98 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:35.776159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c9c4222c-2bf0-4919-a7ad-a5176fcd2b98 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:35.786236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c9c4222c-2bf0-4919-a7ad-a5176fcd2b98 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.166582 Jul 18 17:22:35.786846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1044/1843] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:35 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:22:35.932817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:35.933949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:35.940460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:35.945820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:35.947143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:35.947838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:36.145068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=26 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:36.183880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:36.194890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:36.197070 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:36.198181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4f3e0c98-20c8-4d94-9374-4f5db81db70f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.269286 Jul 18 17:22:36.199284 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1045/1844] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:35 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:36.806406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-086747a5-0403-4f14-b9e1-ceb4fcaf24fe tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:36.807095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-086747a5-0403-4f14-b9e1-ceb4fcaf24fe tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:36.814614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-086747a5-0403-4f14-b9e1-ceb4fcaf24fe tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:36.818363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-086747a5-0403-4f14-b9e1-ceb4fcaf24fe tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:36.818363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-086747a5-0403-4f14-b9e1-ceb4fcaf24fe tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:36.818363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-086747a5-0403-4f14-b9e1-ceb4fcaf24fe tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:36.948499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-086747a5-0403-4f14-b9e1-ceb4fcaf24fe tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:36.955987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-086747a5-0403-4f14-b9e1-ceb4fcaf24fe tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.153493 Jul 18 17:22:36.956600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1046/1845] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:36 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:37.217121 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:37.217727 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:37.223759 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:37.224211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:37.224971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:37.225411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:37.357343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:37.365281 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:37.366891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:37.368009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ea42f7db-54fe-418b-a6b7-cf3a8e83da3e tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.155559 Jul 18 17:22:37.368571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1047/1846] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:37 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:37.974746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c7da1a3d-2b02-42ba-8de2-b2f6d785d989 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:37.975725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c7da1a3d-2b02-42ba-8de2-b2f6d785d989 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:37.985519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7da1a3d-2b02-42ba-8de2-b2f6d785d989 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:37.985970 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7da1a3d-2b02-42ba-8de2-b2f6d785d989 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:37.986737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7da1a3d-2b02-42ba-8de2-b2f6d785d989 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:37.987173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7da1a3d-2b02-42ba-8de2-b2f6d785d989 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:38.114642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c7da1a3d-2b02-42ba-8de2-b2f6d785d989 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:38.118138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:38.122411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c7da1a3d-2b02-42ba-8de2-b2f6d785d989 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.153768 Jul 18 17:22:38.122971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1048/1847] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:37 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:38.389735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:38.390267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:38.396340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:38.396795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:38.397553 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:38.397992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:38.524144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:38.531963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:38.533453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:38.534535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3a27898d-2863-4394-97e7-85dd4c1057ec tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.149640 Jul 18 17:22:38.535091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1049/1848] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:38 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:39.139604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6d944a0f-987f-4652-959c-40bfd14990c3 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:39.140277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6d944a0f-987f-4652-959c-40bfd14990c3 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:39.146579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6d944a0f-987f-4652-959c-40bfd14990c3 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:39.147028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6d944a0f-987f-4652-959c-40bfd14990c3 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:39.147815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6d944a0f-987f-4652-959c-40bfd14990c3 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:39.148251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6d944a0f-987f-4652-959c-40bfd14990c3 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:39.288353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6d944a0f-987f-4652-959c-40bfd14990c3 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:39.290368 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6d944a0f-987f-4652-959c-40bfd14990c3 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.154645 Jul 18 17:22:39.290929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1050/1849] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:39 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:39.552707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:39.553315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:39.559689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:39.560146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:39.560910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:39.561345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:39.689644 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:39.697464 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:39.698969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:39.700147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5a8cdbf9-aad8-43f7-8795-d54536593cc5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.151593 Jul 18 17:22:39.700702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1051/1850] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:39 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:40.308839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b9fda316-6f9f-42b0-868b-461881b89e19 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:40.313233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b9fda316-6f9f-42b0-868b-461881b89e19 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:40.315690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b9fda316-6f9f-42b0-868b-461881b89e19 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:40.316144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b9fda316-6f9f-42b0-868b-461881b89e19 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:40.317020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b9fda316-6f9f-42b0-868b-461881b89e19 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:40.317458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b9fda316-6f9f-42b0-868b-461881b89e19 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:40.454005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b9fda316-6f9f-42b0-868b-461881b89e19 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:40.461562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b9fda316-6f9f-42b0-868b-461881b89e19 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.157820 Jul 18 17:22:40.462129 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1052/1851] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:40 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:40.718446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:40.718971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:40.724978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:40.725422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:40.726173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:40.726648 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:40.854007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:40.861986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:40.863476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:40.864758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cf8154ac-8dbc-49da-9181-9e79ffb6be13 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.150977 Jul 18 17:22:40.865315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1053/1852] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:40 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:41.478782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4bbb38a6-6c27-4983-941f-c9b43126967e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:41.479436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4bbb38a6-6c27-4983-941f-c9b43126967e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:41.486505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bbb38a6-6c27-4983-941f-c9b43126967e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:41.486945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bbb38a6-6c27-4983-941f-c9b43126967e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:41.487723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bbb38a6-6c27-4983-941f-c9b43126967e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:41.488154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4bbb38a6-6c27-4983-941f-c9b43126967e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:41.613217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4bbb38a6-6c27-4983-941f-c9b43126967e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:41.620649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4bbb38a6-6c27-4983-941f-c9b43126967e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.145645 Jul 18 17:22:41.621212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1054/1853] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:41 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:41.883793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:41.884333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:41.890377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:41.890822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:41.891602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:41.892043 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:42.033987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:42.043869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:42.045556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:42.046829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7bc893c8-2769-4b2f-9148-8f37e32372bc tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.167057 Jul 18 17:22:42.051536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1055/1854] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:41 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:42.494778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-d625b2ed-822c-4edc-a9b7-7313dd5a5374 req-1de0e7d3-062d-4fa8-a253-e3d3a041001f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132383c1-3fc0-4d92-a338-48eda2dd1592", "name": "network-vif-plugged", "status": "completed", "tag": "163ac153-2186-439d-ac74-66a80aeff440"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:42.504483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d625b2ed-822c-4edc-a9b7-7313dd5a5374 req-1de0e7d3-062d-4fa8-a253-e3d3a041001f service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:42.504927 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d625b2ed-822c-4edc-a9b7-7313dd5a5374 req-1de0e7d3-062d-4fa8-a253-e3d3a041001f service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:42.516487 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-d625b2ed-822c-4edc-a9b7-7313dd5a5374 req-1de0e7d3-062d-4fa8-a253-e3d3a041001f service nova] Creating event network-vif-plugged:163ac153-2186-439d-ac74-66a80aeff440 for instance 132383c1-3fc0-4d92-a338-48eda2dd1592 on hv-cinder-84617 Jul 18 17:22:42.521361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-d625b2ed-822c-4edc-a9b7-7313dd5a5374 req-1de0e7d3-062d-4fa8-a253-e3d3a041001f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030210 Jul 18 17:22:42.521982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1056/1855] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:22:42.638438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-00b4a09a-87fe-471a-9ae5-8d7acc5bdec4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:42.639238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-00b4a09a-87fe-471a-9ae5-8d7acc5bdec4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:42.645594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00b4a09a-87fe-471a-9ae5-8d7acc5bdec4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:42.646086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00b4a09a-87fe-471a-9ae5-8d7acc5bdec4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:42.646802 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00b4a09a-87fe-471a-9ae5-8d7acc5bdec4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:42.647233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-00b4a09a-87fe-471a-9ae5-8d7acc5bdec4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:42.781498 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-00b4a09a-87fe-471a-9ae5-8d7acc5bdec4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:42.789949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-00b4a09a-87fe-471a-9ae5-8d7acc5bdec4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.155748 Jul 18 17:22:42.800587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1057/1856] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:42 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:22:43.065868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:43.066425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:43.072474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:43.072954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:43.073713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:43.074160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:43.200752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:43.208656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:43.213058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:43.213058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8d2be870-56c7-4b3f-a45f-2b80832a2997 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.149414 Jul 18 17:22:43.213058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1058/1857] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:43 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:43.807830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b017784f-1707-40a4-b183-c18c1bcde3c1 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:43.808500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b017784f-1707-40a4-b183-c18c1bcde3c1 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:43.815870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b017784f-1707-40a4-b183-c18c1bcde3c1 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:43.816323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b017784f-1707-40a4-b183-c18c1bcde3c1 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:43.817082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b017784f-1707-40a4-b183-c18c1bcde3c1 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:43.817520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b017784f-1707-40a4-b183-c18c1bcde3c1 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:43.948851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b017784f-1707-40a4-b183-c18c1bcde3c1 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:43.956772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b017784f-1707-40a4-b183-c18c1bcde3c1 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.152720 Jul 18 17:22:43.957331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1059/1858] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:43 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:44.229843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:44.231548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:44.238001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:44.238767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:44.239778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:44.240221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:44.375110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:44.383031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:44.384565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:44.385650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-744caef6-8399-483a-b8c8-075276c8cd33 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1407 microversion: 2.20 time: 0.159817 Jul 18 17:22:44.386385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1060/1859] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:44 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:44.535925 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-5f61854a-e3dc-4b8d-92bd-3a8321f80e1f req-16e9614d-878f-4351-8915-8aabe83ff891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e4933a-4b2e-4f87-ac28-1de0ece7e8f4", "name": "network-vif-plugged", "status": "completed", "tag": "6e07037e-4e55-43ac-b4c3-5cdb6509ac0c"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:44.544392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5f61854a-e3dc-4b8d-92bd-3a8321f80e1f req-16e9614d-878f-4351-8915-8aabe83ff891 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:44.544822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5f61854a-e3dc-4b8d-92bd-3a8321f80e1f req-16e9614d-878f-4351-8915-8aabe83ff891 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:44.557224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-5f61854a-e3dc-4b8d-92bd-3a8321f80e1f req-16e9614d-878f-4351-8915-8aabe83ff891 service nova] Creating event network-vif-plugged:6e07037e-4e55-43ac-b4c3-5cdb6509ac0c for instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 on hv-cinder-84617 Jul 18 17:22:44.562386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-5f61854a-e3dc-4b8d-92bd-3a8321f80e1f req-16e9614d-878f-4351-8915-8aabe83ff891 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030063 Jul 18 17:22:44.568065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1061/1860] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:22:44.974099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-325248f5-e2df-4f8a-ae24-31d844272f8e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:44.974792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-325248f5-e2df-4f8a-ae24-31d844272f8e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:44.981743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-325248f5-e2df-4f8a-ae24-31d844272f8e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:44.982190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-325248f5-e2df-4f8a-ae24-31d844272f8e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:44.982945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-325248f5-e2df-4f8a-ae24-31d844272f8e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:44.983382 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-325248f5-e2df-4f8a-ae24-31d844272f8e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:45.115991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-325248f5-e2df-4f8a-ae24-31d844272f8e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:45.123373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-325248f5-e2df-4f8a-ae24-31d844272f8e tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1358 microversion: 2.1 time: 0.153955 Jul 18 17:22:45.124039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1062/1861] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:44 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:45.403591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:45.404130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:45.410350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:45.410788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:45.411549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:45.411985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:45.545513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:45.553568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:45.555048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:45.556208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f23a2a0b-5c69-4935-8a1e-7599f6973178 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1599 microversion: 2.20 time: 0.156694 Jul 18 17:22:45.556786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1063/1862] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:22:45 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:22:45.573501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-65e6db56-1aeb-45a6-b784-93d8df5bcfd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:45.573978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-65e6db56-1aeb-45a6-b784-93d8df5bcfd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:45.580428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65e6db56-1aeb-45a6-b784-93d8df5bcfd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:45.580879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65e6db56-1aeb-45a6-b784-93d8df5bcfd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:45.581637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65e6db56-1aeb-45a6-b784-93d8df5bcfd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:45.582356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65e6db56-1aeb-45a6-b784-93d8df5bcfd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:45.659256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-65e6db56-1aeb-45a6-b784-93d8df5bcfd1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089275 Jul 18 17:22:45.659883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1064/1863] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jul 18 17:22:45 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 17:22:46.141728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0b806bb6-d814-4d08-b02e-c87ad10e976c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:46.142474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0b806bb6-d814-4d08-b02e-c87ad10e976c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:46.150632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b806bb6-d814-4d08-b02e-c87ad10e976c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:46.151162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b806bb6-d814-4d08-b02e-c87ad10e976c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:46.153094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b806bb6-d814-4d08-b02e-c87ad10e976c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:46.153705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0b806bb6-d814-4d08-b02e-c87ad10e976c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:46.481375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0b806bb6-d814-4d08-b02e-c87ad10e976c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:46.488912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0b806bb6-d814-4d08-b02e-c87ad10e976c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1546 microversion: 2.1 time: 0.352246 Jul 18 17:22:46.489484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1065/1864] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:46 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1546 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:46.504563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3194e715-0bf6-44db-b00a-47149c0c2e3a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:46.505163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3194e715-0bf6-44db-b00a-47149c0c2e3a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:46.510885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3194e715-0bf6-44db-b00a-47149c0c2e3a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:46.511330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3194e715-0bf6-44db-b00a-47149c0c2e3a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:46.512714 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3194e715-0bf6-44db-b00a-47149c0c2e3a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:46.513165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3194e715-0bf6-44db-b00a-47149c0c2e3a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:46.601098 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:22:46.601709 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:22:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:22:46.763677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3194e715-0bf6-44db-b00a-47149c0c2e3a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:46.771169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3194e715-0bf6-44db-b00a-47149c0c2e3a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1546 microversion: 2.1 time: 0.270094 Jul 18 17:22:46.771771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1066/1865] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:46 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1546 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:46.787260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-72f5889f-d4d7-4c10-b849-a82d2c97398b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:46.790639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-72f5889f-d4d7-4c10-b849-a82d2c97398b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:46.791400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-72f5889f-d4d7-4c10-b849-a82d2c97398b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Searching by: {'deleted': False, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2'} {{(pid=124944) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 17:22:46.798640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72f5889f-d4d7-4c10-b849-a82d2c97398b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:46.799091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72f5889f-d4d7-4c10-b849-a82d2c97398b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:46.799926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72f5889f-d4d7-4c10-b849-a82d2c97398b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:46.800613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-72f5889f-d4d7-4c10-b849-a82d2c97398b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:46.869790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:46.892073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.multi_cell_list [None req-72f5889f-d4d7-4c10-b849-a82d2c97398b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124944) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 17:22:46.989447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-72f5889f-d4d7-4c10-b849-a82d2c97398b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205595 Jul 18 17:22:46.990028 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1067/1866] 10.222.0.26 () {58 vars in 1124 bytes} [Mon Jul 18 17:22:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:22:46.999978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3b59256c-e517-4565-8040-9793ce76f6c5 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:47.000573 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3b59256c-e517-4565-8040-9793ce76f6c5 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:47.006599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b59256c-e517-4565-8040-9793ce76f6c5 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:47.007056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b59256c-e517-4565-8040-9793ce76f6c5 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:47.007873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b59256c-e517-4565-8040-9793ce76f6c5 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:47.008300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b59256c-e517-4565-8040-9793ce76f6c5 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:47.166427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3b59256c-e517-4565-8040-9793ce76f6c5 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:47.175242 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3b59256c-e517-4565-8040-9793ce76f6c5 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1546 microversion: 2.1 time: 0.178901 Jul 18 17:22:47.176141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1068/1867] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:46 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1546 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:47.193003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-5c1708eb-6bb5-4e3a-b8ab-ebdc7eee9718 req-da0938ce-d140-412d-8262-1f95421646cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132383c1-3fc0-4d92-a338-48eda2dd1592", "tag": "163ac153-2186-439d-ac74-66a80aeff440"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:47.200663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5c1708eb-6bb5-4e3a-b8ab-ebdc7eee9718 req-da0938ce-d140-412d-8262-1f95421646cd service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:47.201426 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5c1708eb-6bb5-4e3a-b8ab-ebdc7eee9718 req-da0938ce-d140-412d-8262-1f95421646cd service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:47.212581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-5c1708eb-6bb5-4e3a-b8ab-ebdc7eee9718 req-da0938ce-d140-412d-8262-1f95421646cd service nova] Creating event network-changed:163ac153-2186-439d-ac74-66a80aeff440 for instance 132383c1-3fc0-4d92-a338-48eda2dd1592 on hv-cinder-84617 Jul 18 17:22:47.218538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-5c1708eb-6bb5-4e3a-b8ab-ebdc7eee9718 req-da0938ce-d140-412d-8262-1f95421646cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030261 Jul 18 17:22:47.221193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1069/1868] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:22:49.015369 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-edd4ac9d-bf0d-4de2-b859-a7e9a27b0931 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd3681b3-8cbd-4e43-90c3-f51a6936954e"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:49.016676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-edd4ac9d-bf0d-4de2-b859-a7e9a27b0931 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:49.023337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-edd4ac9d-bf0d-4de2-b859-a7e9a27b0931 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:49.023884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-edd4ac9d-bf0d-4de2-b859-a7e9a27b0931 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:49.024627 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-edd4ac9d-bf0d-4de2-b859-a7e9a27b0931 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:49.025107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-edd4ac9d-bf0d-4de2-b859-a7e9a27b0931 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:49.630487 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-edd4ac9d-bf0d-4de2-b859-a7e9a27b0931 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "POST /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619320 Jul 18 17:22:49.631697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1070/1869] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 17:22:49 2022] POST /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:22:57.174320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:57.178729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-52bf600f-1504-45f5-86c4-bf6309126d60 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:22:57.179420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-52bf600f-1504-45f5-86c4-bf6309126d60 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:22:57.186285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52bf600f-1504-45f5-86c4-bf6309126d60 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:57.186715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52bf600f-1504-45f5-86c4-bf6309126d60 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:57.187481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52bf600f-1504-45f5-86c4-bf6309126d60 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:57.187940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52bf600f-1504-45f5-86c4-bf6309126d60 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:57.325985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-52bf600f-1504-45f5-86c4-bf6309126d60 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:22:57.333910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-52bf600f-1504-45f5-86c4-bf6309126d60 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1592 microversion: 2.1 time: 0.161184 Jul 18 17:22:57.334474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1071/1870] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:22:57 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1592 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:22:59.244482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-c907fbdd-1d64-46a5-b022-4f44d53605fa req-a9a78fd8-1f72-47bc-868c-3cba0071aa4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e4933a-4b2e-4f87-ac28-1de0ece7e8f4", "tag": "6e07037e-4e55-43ac-b4c3-5cdb6509ac0c"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:22:59.252994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=95 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:22:59.254831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-c907fbdd-1d64-46a5-b022-4f44d53605fa req-a9a78fd8-1f72-47bc-868c-3cba0071aa4a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:22:59.255276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-c907fbdd-1d64-46a5-b022-4f44d53605fa req-a9a78fd8-1f72-47bc-868c-3cba0071aa4a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:22:59.266962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-c907fbdd-1d64-46a5-b022-4f44d53605fa req-a9a78fd8-1f72-47bc-868c-3cba0071aa4a service nova] Creating event network-changed:6e07037e-4e55-43ac-b4c3-5cdb6509ac0c for instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 on hv-cinder-84617 Jul 18 17:22:59.271985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-c907fbdd-1d64-46a5-b022-4f44d53605fa req-a9a78fd8-1f72-47bc-868c-3cba0071aa4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031410 Jul 18 17:22:59.272546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1072/1871] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:23:01.512016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-18c6287c-a961-4dd7-a444-a9ec4609acac tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-610194436"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:23:01.515105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-18c6287c-a961-4dd7-a444-a9ec4609acac tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:01.519386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18c6287c-a961-4dd7-a444-a9ec4609acac tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:01.519880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18c6287c-a961-4dd7-a444-a9ec4609acac tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:01.520613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18c6287c-a961-4dd7-a444-a9ec4609acac tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:01.521048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18c6287c-a961-4dd7-a444-a9ec4609acac tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:01.649634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.network.security_group_api [None req-18c6287c-a961-4dd7-a444-a9ec4609acac tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Adding security group ef5ae3a5-b5ad-4304-9073-6f1a69b85795 to port 6e07037e-4e55-43ac-b4c3-5cdb6509ac0c Jul 18 17:23:02.059280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-18c6287c-a961-4dd7-a444-a9ec4609acac tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "POST /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/action" status: 202 len: 0 microversion: 2.1 time: 0.551986 Jul 18 17:23:02.059952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1073/1872] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 17:23:01 2022] POST /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:23:02.067764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-e330f3a8-1934-4d63-836b-5a7c48a0f1f6 req-9aa754c2-0c9b-46b2-829d-b26f04cf4a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e4933a-4b2e-4f87-ac28-1de0ece7e8f4", "tag": "6e07037e-4e55-43ac-b4c3-5cdb6509ac0c"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:23:02.078639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-e330f3a8-1934-4d63-836b-5a7c48a0f1f6 req-9aa754c2-0c9b-46b2-829d-b26f04cf4a2a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:02.079452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-e330f3a8-1934-4d63-836b-5a7c48a0f1f6 req-9aa754c2-0c9b-46b2-829d-b26f04cf4a2a service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:02.096845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-e330f3a8-1934-4d63-836b-5a7c48a0f1f6 req-9aa754c2-0c9b-46b2-829d-b26f04cf4a2a service nova] Creating event network-changed:6e07037e-4e55-43ac-b4c3-5cdb6509ac0c for instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 on hv-cinder-84617 Jul 18 17:23:02.109628 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-e330f3a8-1934-4d63-836b-5a7c48a0f1f6 req-9aa754c2-0c9b-46b2-829d-b26f04cf4a2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046035 Jul 18 17:23:02.123443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1074/1873] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:23:02.133787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9c892f9a-c189-4ab8-8e2a-2bec6941a443 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:02.134565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9c892f9a-c189-4ab8-8e2a-2bec6941a443 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:02.143901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c892f9a-c189-4ab8-8e2a-2bec6941a443 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:02.144430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c892f9a-c189-4ab8-8e2a-2bec6941a443 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:02.145278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c892f9a-c189-4ab8-8e2a-2bec6941a443 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:02.145991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9c892f9a-c189-4ab8-8e2a-2bec6941a443 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:02.416153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9c892f9a-c189-4ab8-8e2a-2bec6941a443 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:02.426527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9c892f9a-c189-4ab8-8e2a-2bec6941a443 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1757 microversion: 2.1 time: 0.298310 Jul 18 17:23:02.427314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1075/1874] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:02 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1757 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:23:22.972593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-52b4e12d-51cb-4e35-8f0d-4dcc88eaead7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:22.973309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-52b4e12d-51cb-4e35-8f0d-4dcc88eaead7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:22.975655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=7 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:23:22.976301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:23:22.981146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52b4e12d-51cb-4e35-8f0d-4dcc88eaead7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:22.981588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52b4e12d-51cb-4e35-8f0d-4dcc88eaead7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:22.982343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52b4e12d-51cb-4e35-8f0d-4dcc88eaead7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:22.982775 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-52b4e12d-51cb-4e35-8f0d-4dcc88eaead7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:23.007149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-52b4e12d-51cb-4e35-8f0d-4dcc88eaead7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/ips" status: 200 len: 152 microversion: 2.20 time: 0.038612 Jul 18 17:23:23.007744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1076/1875] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jul 18 17:23:22 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 17:23:24.991523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cabddb6f-0499-4ea1-849c-84fe3b0b1d63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:23:24.992550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cabddb6f-0499-4ea1-849c-84fe3b0b1d63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:25.000225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cabddb6f-0499-4ea1-849c-84fe3b0b1d63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:25.000680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cabddb6f-0499-4ea1-849c-84fe3b0b1d63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:25.001498 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cabddb6f-0499-4ea1-849c-84fe3b0b1d63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:25.001947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cabddb6f-0499-4ea1-849c-84fe3b0b1d63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:25.200255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cabddb6f-0499-4ea1-849c-84fe3b0b1d63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "POST /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/action" status: 202 len: 0 microversion: 2.1 time: 0.212790 Jul 18 17:23:25.200998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1077/1876] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 17:23:24 2022] POST /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:23:25.208728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9fef23b8-efe1-4ba3-b801-08812152777a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:23:25.209348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9fef23b8-efe1-4ba3-b801-08812152777a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:25.215654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fef23b8-efe1-4ba3-b801-08812152777a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:25.216118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fef23b8-efe1-4ba3-b801-08812152777a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:25.216915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fef23b8-efe1-4ba3-b801-08812152777a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:25.217355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9fef23b8-efe1-4ba3-b801-08812152777a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:25.240664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-9fef23b8-efe1-4ba3-b801-08812152777a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lazy-loading 'flavor' on Instance uuid 132383c1-3fc0-4d92-a338-48eda2dd1592 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:23:25.835709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9fef23b8-efe1-4ba3-b801-08812152777a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/action" status: 202 len: 0 microversion: 2.20 time: 0.632844 Jul 18 17:23:25.836373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1078/1877] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 18 17:23:25 2022] POST /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:23:25.841223 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-321d4a2c-4f39-4882-ad74-7eac8cf43236 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:25.841908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-321d4a2c-4f39-4882-ad74-7eac8cf43236 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:25.848879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-321d4a2c-4f39-4882-ad74-7eac8cf43236 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:25.849326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-321d4a2c-4f39-4882-ad74-7eac8cf43236 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:25.850074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-321d4a2c-4f39-4882-ad74-7eac8cf43236 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:25.850508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-321d4a2c-4f39-4882-ad74-7eac8cf43236 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:25.998191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-321d4a2c-4f39-4882-ad74-7eac8cf43236 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:26.006771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-321d4a2c-4f39-4882-ad74-7eac8cf43236 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1749 microversion: 2.1 time: 0.169292 Jul 18 17:23:26.007325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1079/1878] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:25 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:23:26.011635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:26.012313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:26.018995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:26.023596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:26.023596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:26.023596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:26.152211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:26.160870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:26.162380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:26.163557 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c7d34112-7b96-4e20-9ef6-591a1b2bd945 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.155273 Jul 18 17:23:26.164132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1080/1879] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:26 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:27.024549 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-646260f8-7162-43e9-a69d-8ffeab33c48a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:27.025204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-646260f8-7162-43e9-a69d-8ffeab33c48a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:27.032258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-646260f8-7162-43e9-a69d-8ffeab33c48a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:27.032697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-646260f8-7162-43e9-a69d-8ffeab33c48a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:27.033437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-646260f8-7162-43e9-a69d-8ffeab33c48a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:27.033863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-646260f8-7162-43e9-a69d-8ffeab33c48a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:27.177152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-646260f8-7162-43e9-a69d-8ffeab33c48a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:27.185302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-646260f8-7162-43e9-a69d-8ffeab33c48a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1754 microversion: 2.1 time: 0.164471 Jul 18 17:23:27.186011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1081/1880] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:27 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:27.190439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:27.191080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:27.196930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:27.197372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:27.198110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:27.198539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:27.326121 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:27.334662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:27.336192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:27.337337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-75c9488d-d063-4772-b54d-b57c8a8d9515 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.150426 Jul 18 17:23:27.337897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1082/1881] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:27 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:28.212404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b92700f4-e898-4bc3-8360-c66f1d31f729 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:28.212404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b92700f4-e898-4bc3-8360-c66f1d31f729 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:28.212404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b92700f4-e898-4bc3-8360-c66f1d31f729 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:28.212404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b92700f4-e898-4bc3-8360-c66f1d31f729 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:28.213354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b92700f4-e898-4bc3-8360-c66f1d31f729 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:28.213354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b92700f4-e898-4bc3-8360-c66f1d31f729 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:28.354124 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b92700f4-e898-4bc3-8360-c66f1d31f729 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:28.364001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b92700f4-e898-4bc3-8360-c66f1d31f729 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1754 microversion: 2.1 time: 0.163949 Jul 18 17:23:28.364561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1083/1882] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:28 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:28.369065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:28.369661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:28.376079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:28.376525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:28.377268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:28.377700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:28.509201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:28.517101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:28.518560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:28.519709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e81a9a43-155d-45da-833b-5bc322364b6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.154078 Jul 18 17:23:28.520249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1084/1883] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:28 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:29.380605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-85a2607e-7476-4c85-b5a0-f314f0cc86ea tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:29.381283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-85a2607e-7476-4c85-b5a0-f314f0cc86ea tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:29.387566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85a2607e-7476-4c85-b5a0-f314f0cc86ea tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:29.388009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85a2607e-7476-4c85-b5a0-f314f0cc86ea tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:29.388746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85a2607e-7476-4c85-b5a0-f314f0cc86ea tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:29.389175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-85a2607e-7476-4c85-b5a0-f314f0cc86ea tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:29.685274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-85a2607e-7476-4c85-b5a0-f314f0cc86ea tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:29.693325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-85a2607e-7476-4c85-b5a0-f314f0cc86ea tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1754 microversion: 2.1 time: 0.316493 Jul 18 17:23:29.693869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1085/1884] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:29 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1754 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:29.698184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:29.698766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:29.704942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:29.705381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:29.706121 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:29.706577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:29.840118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:29.848653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:29.850150 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:29.851303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b75a661a-7657-448d-a8f0-3ef7cda7bcc9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.156536 Jul 18 17:23:29.851887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1086/1885] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:29 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:30.710154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f378bb59-3f19-4845-8448-a32bc246d31c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:30.710804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f378bb59-3f19-4845-8448-a32bc246d31c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:30.717380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f378bb59-3f19-4845-8448-a32bc246d31c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:30.718310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f378bb59-3f19-4845-8448-a32bc246d31c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:30.719107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f378bb59-3f19-4845-8448-a32bc246d31c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:30.719575 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f378bb59-3f19-4845-8448-a32bc246d31c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:30.860357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f378bb59-3f19-4845-8448-a32bc246d31c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:30.868358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f378bb59-3f19-4845-8448-a32bc246d31c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1754 microversion: 2.1 time: 0.162131 Jul 18 17:23:30.868926 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1087/1886] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:30 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:30.873226 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:30.873858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:30.880069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:30.880520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:30.881268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:30.881699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:31.019548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:31.027479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:31.029044 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:31.030190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fe174be5-827b-4aae-a4cd-9976a61ed71f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.160363 Jul 18 17:23:31.030734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1088/1887] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:30 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:31.885678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-938d5e88-9278-449f-8a2d-a5ea611b4703 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:31.886356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-938d5e88-9278-449f-8a2d-a5ea611b4703 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:31.893212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-938d5e88-9278-449f-8a2d-a5ea611b4703 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:31.893659 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-938d5e88-9278-449f-8a2d-a5ea611b4703 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:31.894444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-938d5e88-9278-449f-8a2d-a5ea611b4703 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:31.894902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-938d5e88-9278-449f-8a2d-a5ea611b4703 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:32.038934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-938d5e88-9278-449f-8a2d-a5ea611b4703 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:32.042397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:23:32.047640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-938d5e88-9278-449f-8a2d-a5ea611b4703 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1754 microversion: 2.1 time: 0.165843 Jul 18 17:23:32.048229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1089/1888] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:31 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:32.052885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:32.053767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:32.059241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:32.059716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:32.060929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:32.060929 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:32.194408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:32.202674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:32.204191 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:32.205375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6736df5b-860c-45f7-80d2-5058483dc65a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.156246 Jul 18 17:23:32.205928 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1090/1889] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:32 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:33.069982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d5352e3e-90da-4a55-a748-a1500fcc1bb6 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:33.070600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d5352e3e-90da-4a55-a748-a1500fcc1bb6 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:33.077052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d5352e3e-90da-4a55-a748-a1500fcc1bb6 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:33.078081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d5352e3e-90da-4a55-a748-a1500fcc1bb6 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:33.078875 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d5352e3e-90da-4a55-a748-a1500fcc1bb6 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:33.079396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d5352e3e-90da-4a55-a748-a1500fcc1bb6 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:33.225362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d5352e3e-90da-4a55-a748-a1500fcc1bb6 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:33.233267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d5352e3e-90da-4a55-a748-a1500fcc1bb6 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1754 microversion: 2.1 time: 0.167219 Jul 18 17:23:33.233847 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1091/1890] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:33 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:33.238460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:33.239047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:33.244626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:33.245065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:33.245807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:33.246237 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:33.373193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:33.381745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:33.383248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:33.384433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-351ede61-344b-4566-917f-e32fc20e2b03 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.149505 Jul 18 17:23:33.384988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1092/1891] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:33 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:34.250472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0d777126-0a23-401a-a14e-e3684517e5e4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:34.251114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0d777126-0a23-401a-a14e-e3684517e5e4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:34.257666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d777126-0a23-401a-a14e-e3684517e5e4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:34.258124 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d777126-0a23-401a-a14e-e3684517e5e4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:34.258881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d777126-0a23-401a-a14e-e3684517e5e4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:34.259323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d777126-0a23-401a-a14e-e3684517e5e4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:34.401491 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0d777126-0a23-401a-a14e-e3684517e5e4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:34.411815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0d777126-0a23-401a-a14e-e3684517e5e4 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1754 microversion: 2.1 time: 0.165192 Jul 18 17:23:34.412379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1093/1892] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:34 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:34.416965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:34.417561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:34.423275 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:34.423752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:34.424508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:34.424944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:34.552082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:34.559857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:34.561346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:34.563362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fa8441ae-5741-4261-97c7-aac58d1fad83 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.150073 Jul 18 17:23:34.563945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1094/1893] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:34 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:35.429254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-388c60ca-d577-40b6-93b3-3d9aa1a55e63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:35.429897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-388c60ca-d577-40b6-93b3-3d9aa1a55e63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:35.436378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-388c60ca-d577-40b6-93b3-3d9aa1a55e63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:35.436863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-388c60ca-d577-40b6-93b3-3d9aa1a55e63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:35.437621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-388c60ca-d577-40b6-93b3-3d9aa1a55e63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:35.438261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-388c60ca-d577-40b6-93b3-3d9aa1a55e63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:35.581253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-388c60ca-d577-40b6-93b3-3d9aa1a55e63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:35.589268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-388c60ca-d577-40b6-93b3-3d9aa1a55e63 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1754 microversion: 2.1 time: 0.164150 Jul 18 17:23:35.589825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1095/1894] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:35 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:35.595020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:35.595650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:35.601299 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:35.601752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:35.602512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:35.602953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:35.728647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:35.736912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:35.738413 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:35.739588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-58cee67b-7fef-4a1d-8f60-5efd344f697a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.148833 Jul 18 17:23:35.740149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1096/1895] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:35 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:36.606764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b2c2cf7e-4918-4d0d-adc2-b0afa1c999cb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:36.607367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b2c2cf7e-4918-4d0d-adc2-b0afa1c999cb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:36.613989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2c2cf7e-4918-4d0d-adc2-b0afa1c999cb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:36.614458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2c2cf7e-4918-4d0d-adc2-b0afa1c999cb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:36.615201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2c2cf7e-4918-4d0d-adc2-b0afa1c999cb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:36.615683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b2c2cf7e-4918-4d0d-adc2-b0afa1c999cb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:36.756754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b2c2cf7e-4918-4d0d-adc2-b0afa1c999cb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:36.764551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b2c2cf7e-4918-4d0d-adc2-b0afa1c999cb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1754 microversion: 2.1 time: 0.161579 Jul 18 17:23:36.765743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1097/1896] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:36 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:36.770172 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:36.770761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:36.776254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:36.776696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:36.777437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:36.777867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:36.908852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:36.916650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:36.918125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:36.919266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-37a331fd-91f9-4bc3-8ebd-7851b37d67f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.152564 Jul 18 17:23:36.919844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1098/1897] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:36 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:37.782181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cc5f67ba-f2c7-4820-8691-fcaeb950c5d2 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:37.782919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cc5f67ba-f2c7-4820-8691-fcaeb950c5d2 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:37.789305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cc5f67ba-f2c7-4820-8691-fcaeb950c5d2 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:37.789746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cc5f67ba-f2c7-4820-8691-fcaeb950c5d2 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:37.790496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cc5f67ba-f2c7-4820-8691-fcaeb950c5d2 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:37.790965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cc5f67ba-f2c7-4820-8691-fcaeb950c5d2 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:37.936609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cc5f67ba-f2c7-4820-8691-fcaeb950c5d2 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:37.944506 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cc5f67ba-f2c7-4820-8691-fcaeb950c5d2 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1757 microversion: 2.1 time: 0.166712 Jul 18 17:23:37.957047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1099/1898] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:23:37 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:23:37.957047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:37.957047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:37.957047 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:37.957482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:37.957482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:37.957803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:38.089088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:38.096977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:38.098474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:38.099650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-14d558eb-4429-4674-bc13-a44b79680e26 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.153611 Jul 18 17:23:38.100214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1100/1899] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:37 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:39.118059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:39.118696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:39.125671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:39.126119 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:39.126884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:39.127324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:39.256212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:39.264076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:39.266262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:39.267447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-93ce14b1-07cf-4fc7-aefd-959069828885 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.153363 Jul 18 17:23:39.268186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1101/1900] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:39 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:40.285985 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:40.286667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:40.293284 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:40.293736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:40.294499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:40.294939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:40.427939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:40.436076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:40.438211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:40.439594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-25c32672-16af-44f0-a92c-a42d8131eca3 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.157469 Jul 18 17:23:40.440146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1102/1901] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:40 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:41.458821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:41.459530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:41.465962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:41.466411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:41.467175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:41.467649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:41.595739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:41.603559 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:41.605095 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:41.606249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a3cab2ae-b978-47b1-a5da-7850b9889785 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.151341 Jul 18 17:23:41.606807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1103/1902] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:41 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:42.624723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:42.625388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:42.631726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:42.632169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:42.632911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:42.633341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:42.758913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:42.766790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:42.768297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:42.769446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b887c6de-1c47-4ba1-a6fb-4792d4d665e1 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.149192 Jul 18 17:23:42.770002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1104/1903] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:42 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:43.787414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:43.788119 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:43.794581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:43.796620 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:43.797475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:43.797906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:43.930455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:43.938383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:43.939895 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:43.941040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0f34fb31-62f8-4b13-8153-8178156b422d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.157463 Jul 18 17:23:43.941602 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1105/1904] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:43 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:44.959374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:44.960676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:44.967201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:44.968184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:44.969022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:44.969454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:44.990633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:23:45.100155 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:45.107820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:45.110006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:45.111153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-632c4c83-c6d2-4558-b526-f7290e3302b7 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.155668 Jul 18 17:23:45.111753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1106/1905] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:44 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:46.129446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:46.130125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:46.136666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:46.137119 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:46.137876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:46.138316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:46.271032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:46.280736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:46.282264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:46.283438 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7ffcdefb-060c-4c7f-9d5b-5dee24f5cb1d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.158600 Jul 18 17:23:46.284077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1107/1906] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:46 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:47.302208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:47.302899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:47.309380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:47.309820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:47.310560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:47.310992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:47.440529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:47.448360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:47.449841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:47.450983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9395c0c7-5745-4651-aa17-ec007cbfce91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1745 microversion: 2.20 time: 0.153092 Jul 18 17:23:47.451556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1108/1907] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:47 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:48.469884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:48.470590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:48.477036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:48.477486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:48.478261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:48.478703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:48.621213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:48.632091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:48.632091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:48.633247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9b3af521-f3bf-4828-a807-c16c0c2a7561 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1745 microversion: 2.20 time: 0.168076 Jul 18 17:23:48.644704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1109/1908] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:48 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:49.654455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:49.656080 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:49.664214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:49.664662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:49.665434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:49.665873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:49.858689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:49.867723 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:49.869759 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:49.870363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4e483e28-9741-4d17-9097-80144f82fcdb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1740 microversion: 2.20 time: 0.220007 Jul 18 17:23:49.870947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1110/1909] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:49 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:50.553341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-5a57954d-8043-485d-ac7b-b0eccb4c24d2 req-24e88d37-682b-4e3a-bdf9-7820039e0b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132383c1-3fc0-4d92-a338-48eda2dd1592", "name": "network-vif-plugged", "status": "completed", "tag": "163ac153-2186-439d-ac74-66a80aeff440"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:23:50.555953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5a57954d-8043-485d-ac7b-b0eccb4c24d2 req-24e88d37-682b-4e3a-bdf9-7820039e0b2e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:50.556440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5a57954d-8043-485d-ac7b-b0eccb4c24d2 req-24e88d37-682b-4e3a-bdf9-7820039e0b2e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:50.574159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-5a57954d-8043-485d-ac7b-b0eccb4c24d2 req-24e88d37-682b-4e3a-bdf9-7820039e0b2e service nova] Creating event network-vif-plugged:163ac153-2186-439d-ac74-66a80aeff440 for instance 132383c1-3fc0-4d92-a338-48eda2dd1592 on hv-cinder-84617 Jul 18 17:23:50.581869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-5a57954d-8043-485d-ac7b-b0eccb4c24d2 req-24e88d37-682b-4e3a-bdf9-7820039e0b2e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043401 Jul 18 17:23:50.582482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1111/1910] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:23:50.890892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:50.891821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:50.898757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:50.899211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:50.900012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:50.900638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:51.056579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:51.066099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:51.067965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:51.069456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8dba4f83-e1a3-446f-b62d-96f46d29e401 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1740 microversion: 2.20 time: 0.183373 Jul 18 17:23:51.081135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1112/1911] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:50 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:52.089452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:52.090141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:52.096850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:52.097302 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:52.098069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:52.098508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:52.252295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:52.263236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:52.264786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:52.266268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6a0b001d-eea3-48e8-8044-a8c909a6c97f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1740 microversion: 2.20 time: 0.180821 Jul 18 17:23:52.266826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1113/1912] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:52 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:53.286841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:53.288208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:53.294859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:53.295334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:53.299038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:53.299590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:53.441937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:53.452711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:53.454745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:53.455937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fb11b1fc-704a-4a73-a08d-8bc02bbf8ea9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1740 microversion: 2.20 time: 0.173064 Jul 18 17:23:53.456855 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1114/1913] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:53 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:54.475292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:54.476100 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:54.483572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:54.484023 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:54.484808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:54.485257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:54.645853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:54.654698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:54.656941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:54.658268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9a1e849a-1ef4-4d09-b78e-c6dd1529feb2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1740 microversion: 2.20 time: 0.187159 Jul 18 17:23:54.658863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1115/1914] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:54 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:55.677513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:55.678888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:55.681596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=81 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:23:55.686545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:55.687243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:55.688826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:55.689270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:55.839351 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:55.849720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:55.851323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:55.852574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-351e774d-2d09-4a8a-88d5-6168ca09f676 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1740 microversion: 2.20 time: 0.179371 Jul 18 17:23:55.863485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1116/1915] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:55 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:23:56.870005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:56.871590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:56.881290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:56.881829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:56.882846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:56.883479 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:57.027653 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:57.037534 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:57.039198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:57.040398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-97895bdd-1e05-491e-9dc2-09bdc3bc2705 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1740 microversion: 2.20 time: 0.174176 Jul 18 17:23:57.052211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1117/1916] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:56 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:58.059579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:58.060365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:58.067845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:58.068307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:58.069120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:58.069597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:58.210940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:58.218883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:58.220444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:58.221617 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-506c491b-7f9b-4637-8269-f0e8bcd11083 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1740 microversion: 2.20 time: 0.166034 Jul 18 17:23:58.222181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1118/1917] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:58 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:23:59.240843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:23:59.241478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:23:59.248600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:59.251292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:59.251292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:23:59.251292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:23:59.385179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:59.393782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:59.398984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:23:59.398984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8111ecc3-9d46-4524-a9d7-3b7241105e91 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1740 microversion: 2.20 time: 0.159544 Jul 18 17:23:59.398984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1119/1918] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:23:59 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:00.416094 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:00.417185 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:00.426326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:00.429329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:00.429329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:00.429329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:00.637983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:00.646843 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:00.648722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:00.649889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e79e6fb9-758b-438b-aa9a-9e32d215821c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1722 microversion: 2.20 time: 0.238467 Jul 18 17:24:00.650449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1120/1919] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:00 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:01.668338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:01.669015 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:01.676423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:01.677132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:01.677919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:01.678360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:01.807372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:01.815220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:01.816746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:01.817896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a5c057b5-2d13-4345-ae02-9bb6ceede18b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1722 microversion: 2.20 time: 0.153441 Jul 18 17:24:01.818456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1121/1920] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:01 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:02.835313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:02.836056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:02.842220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:02.842608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:02.843349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:02.843801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:02.979039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:02.987837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:02.989306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:02.990442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-67edaa44-c212-45a6-858f-40568e69cac6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1725 microversion: 2.20 time: 0.159022 Jul 18 17:24:02.990992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1122/1921] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:02 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:03.007691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-24ef0de9-91fd-48ec-9e26-69e5fe6942b2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "122360fe-b9f2-401b-80e4-91b64e4c9bb3"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:24:03.008736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-24ef0de9-91fd-48ec-9e26-69e5fe6942b2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:03.014587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-24ef0de9-91fd-48ec-9e26-69e5fe6942b2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:03.018983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-24ef0de9-91fd-48ec-9e26-69e5fe6942b2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:03.018983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-24ef0de9-91fd-48ec-9e26-69e5fe6942b2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:03.018983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-24ef0de9-91fd-48ec-9e26-69e5fe6942b2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:03.086561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:24:03.939682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-24ef0de9-91fd-48ec-9e26-69e5fe6942b2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.935664 Jul 18 17:24:03.940299 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1123/1922] 10.222.0.26 () {62 vars in 1363 bytes} [Mon Jul 18 17:24:03 2022] POST /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/os-volume_attachments => generated 188 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 17:24:04.054449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e3a061ce-e0ab-4956-81d1-020aba68597c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:04.054939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e3a061ce-e0ab-4956-81d1-020aba68597c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:04.060930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e3a061ce-e0ab-4956-81d1-020aba68597c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:04.061377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e3a061ce-e0ab-4956-81d1-020aba68597c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:04.062130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e3a061ce-e0ab-4956-81d1-020aba68597c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:04.062567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e3a061ce-e0ab-4956-81d1-020aba68597c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:04.629130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e3a061ce-e0ab-4956-81d1-020aba68597c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "DELETE /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/os-volume_attachments/122360fe-b9f2-401b-80e4-91b64e4c9bb3" status: 202 len: 0 microversion: 2.20 time: 0.578539 Jul 18 17:24:04.633274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1124/1923] 10.222.0.26 () {60 vars in 1456 bytes} [Mon Jul 18 17:24:04 2022] DELETE /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/os-volume_attachments/122360fe-b9f2-401b-80e4-91b64e4c9bb3 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:24:04.636712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-308b62a4-f0ff-4370-aa6e-52c9bdf0422e req-b7cb8516-39d4-42f6-b9f7-5d1d641f5bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132383c1-3fc0-4d92-a338-48eda2dd1592", "name": "network-vif-unplugged", "status": "completed", "tag": "163ac153-2186-439d-ac74-66a80aeff440"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:24:04.645792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-308b62a4-f0ff-4370-aa6e-52c9bdf0422e req-b7cb8516-39d4-42f6-b9f7-5d1d641f5bec service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:04.646225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-308b62a4-f0ff-4370-aa6e-52c9bdf0422e req-b7cb8516-39d4-42f6-b9f7-5d1d641f5bec service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:04.660037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.compute.server_external_events [req-308b62a4-f0ff-4370-aa6e-52c9bdf0422e req-b7cb8516-39d4-42f6-b9f7-5d1d641f5bec service nova] Unable to find a host for instance 132383c1-3fc0-4d92-a338-48eda2dd1592. Dropping event network-vif-unplugged {{(pid=124944) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 17:24:04.667789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-308b62a4-f0ff-4370-aa6e-52c9bdf0422e req-b7cb8516-39d4-42f6-b9f7-5d1d641f5bec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029383 Jul 18 17:24:04.667789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1125/1924] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 17:24:04.690339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-794e3aab-d2c3-4a6b-9f07-f8dd9653b4b5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:24:04.690913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-794e3aab-d2c3-4a6b-9f07-f8dd9653b4b5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:04.697429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-794e3aab-d2c3-4a6b-9f07-f8dd9653b4b5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:04.697881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-794e3aab-d2c3-4a6b-9f07-f8dd9653b4b5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:04.699668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-794e3aab-d2c3-4a6b-9f07-f8dd9653b4b5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:04.699668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-794e3aab-d2c3-4a6b-9f07-f8dd9653b4b5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:04.862428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-794e3aab-d2c3-4a6b-9f07-f8dd9653b4b5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "POST /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/action" status: 202 len: 0 microversion: 2.20 time: 0.177015 Jul 18 17:24:04.862944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1126/1925] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jul 18 17:24:04 2022] POST /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:24:04.870849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:04.871454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:04.878135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:04.878588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:04.879356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:04.879827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:05.012591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:05.021565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:05.023069 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:05.024276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a40a6317-9b5c-4977-bc9a-3bc67bb98fc6 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1673 microversion: 2.20 time: 0.157121 Jul 18 17:24:05.024839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1127/1926] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:04 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:06.042107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:06.042750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:06.052822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:06.053636 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:06.054904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:06.055598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:06.192846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:06.200895 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:06.202420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:06.203633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1dcf23c4-2a0b-4314-93e5-ff45c20d51bf tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1673 microversion: 2.20 time: 0.165362 Jul 18 17:24:06.204186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1128/1927] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:06 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:07.222563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:07.223475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:07.230286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:07.230746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:07.231514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:07.231973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:07.428755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:07.437519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:07.439662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:07.440823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a66dc081-7ec3-4117-8c16-b296cce99e55 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.223249 Jul 18 17:24:07.441377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1129/1928] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:07 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:08.460442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:08.461313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:08.470449 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:08.471415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:08.472656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:08.473352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:08.632593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:08.641087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:08.643051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:08.644251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f0d679b6-c11c-4dc3-9b7c-98da2dc2196f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.188705 Jul 18 17:24:08.644798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1130/1929] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:08 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:24:09.662375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:09.663763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:09.670297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:09.670744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:09.671517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:09.671974 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:09.815899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:09.824594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:09.826139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:09.827308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-241ef289-efe0-42f8-bbc2-d71ab1a8b1f4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.168854 Jul 18 17:24:09.827894 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1131/1930] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:09 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:10.847360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:10.848224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:10.856154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:10.856910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:10.857789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:10.858285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:11.012621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:11.021054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:11.022543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:11.023721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-97f547db-9fab-44dd-af85-c7297e8872c4 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.181907 Jul 18 17:24:11.024273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1132/1931] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:10 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:12.044232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:12.046057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:12.054497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:12.054947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:12.055750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:12.056197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:12.219631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:12.228508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:12.229988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:12.231139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-37035ff1-1207-41e4-974c-3bb095e73d8f tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.192853 Jul 18 17:24:12.231716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1133/1932] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:12 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:24:13.250572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:13.251404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:13.258278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:13.258524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:13.259294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:13.259771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:13.409142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:13.417020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:13.418508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:13.419705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ab8a09fc-d639-4e89-8cf3-4b2ccd0036f9 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.173523 Jul 18 17:24:13.420448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1134/1933] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:13 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:14.118208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8ac0388b-c921-41ab-8e68-042be6e86dfb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-610194436"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:24:14.118689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8ac0388b-c921-41ab-8e68-042be6e86dfb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:14.124888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8ac0388b-c921-41ab-8e68-042be6e86dfb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:14.126655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8ac0388b-c921-41ab-8e68-042be6e86dfb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:14.127092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8ac0388b-c921-41ab-8e68-042be6e86dfb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:14.127555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8ac0388b-c921-41ab-8e68-042be6e86dfb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:14.130072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:24:14.273202 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.network.security_group_api [None req-8ac0388b-c921-41ab-8e68-042be6e86dfb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Removing security group ef5ae3a5-b5ad-4304-9073-6f1a69b85795 from port 6e07037e-4e55-43ac-b4c3-5cdb6509ac0c Jul 18 17:24:14.387857 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:24:14.388813 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:24:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:24:14.720819 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8ac0388b-c921-41ab-8e68-042be6e86dfb tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "POST /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/action" status: 202 len: 0 microversion: 2.1 time: 0.606108 Jul 18 17:24:14.724703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1135/1934] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jul 18 17:24:14 2022] POST /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:24:14.729838 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:14.730857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:14.751267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:14.751754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:14.752543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:14.764131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:15.110753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:15.122952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:15.124937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:15.126821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b38b8f76-cec3-48f5-9299-0548a1cf4e6d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.401232 Jul 18 17:24:15.127472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1136/1935] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:14 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:24:15.154801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-b33942b1-ae7a-4f80-a968-66b70c1399c2 req-1a10a870-5996-4d9a-a428-813919939ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e4933a-4b2e-4f87-ac28-1de0ece7e8f4", "tag": "6e07037e-4e55-43ac-b4c3-5cdb6509ac0c"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:24:15.178721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-b33942b1-ae7a-4f80-a968-66b70c1399c2 req-1a10a870-5996-4d9a-a428-813919939ea1 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:15.179997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-b33942b1-ae7a-4f80-a968-66b70c1399c2 req-1a10a870-5996-4d9a-a428-813919939ea1 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:15.206434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-b33942b1-ae7a-4f80-a968-66b70c1399c2 req-1a10a870-5996-4d9a-a428-813919939ea1 service nova] Creating event network-changed:6e07037e-4e55-43ac-b4c3-5cdb6509ac0c for instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 on hv-cinder-84617 Jul 18 17:24:15.217962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-b33942b1-ae7a-4f80-a968-66b70c1399c2 req-1a10a870-5996-4d9a-a428-813919939ea1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089231 Jul 18 17:24:15.225708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1137/1936] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:24:16.158270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:16.159048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:16.170815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:16.203021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:16.203021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:16.203021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:16.396704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:16.411210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:16.412811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:16.413992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9b574c65-e900-4b00-b063-888e975bc6d2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.271666 Jul 18 17:24:16.414596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1138/1937] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:16 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:16.624133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-55c34b43-3dc6-4954-bbb8-16d1de85d36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:16.624626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-55c34b43-3dc6-4954-bbb8-16d1de85d36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:16.631118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-55c34b43-3dc6-4954-bbb8-16d1de85d36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:16.631603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-55c34b43-3dc6-4954-bbb8-16d1de85d36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:16.632495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-55c34b43-3dc6-4954-bbb8-16d1de85d36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:16.632874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-55c34b43-3dc6-4954-bbb8-16d1de85d36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:16.719580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-55c34b43-3dc6-4954-bbb8-16d1de85d36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lazy-loading 'services' on Instance uuid 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:24:16.900201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-55c34b43-3dc6-4954-bbb8-16d1de85d36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "DELETE /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments/dd3681b3-8cbd-4e43-90c3-f51a6936954e" status: 202 len: 0 microversion: 2.1 time: 0.279706 Jul 18 17:24:16.900868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1139/1938] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 17:24:16 2022] DELETE /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments/dd3681b3-8cbd-4e43-90c3-f51a6936954e => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:24:16.906502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-f57754a7-ad4e-4f9a-a48a-75145d762e4a req-9968d1ef-4c36-4b4a-b8d1-76e2e139697b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51e4933a-4b2e-4f87-ac28-1de0ece7e8f4", "tag": "6e07037e-4e55-43ac-b4c3-5cdb6509ac0c"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:24:16.915462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f57754a7-ad4e-4f9a-a48a-75145d762e4a req-9968d1ef-4c36-4b4a-b8d1-76e2e139697b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:16.915918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-f57754a7-ad4e-4f9a-a48a-75145d762e4a req-9968d1ef-4c36-4b4a-b8d1-76e2e139697b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:16.928679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-f57754a7-ad4e-4f9a-a48a-75145d762e4a req-9968d1ef-4c36-4b4a-b8d1-76e2e139697b service nova] Creating event network-changed:6e07037e-4e55-43ac-b4c3-5cdb6509ac0c for instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 on hv-cinder-84617 Jul 18 17:24:16.933756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-f57754a7-ad4e-4f9a-a48a-75145d762e4a req-9968d1ef-4c36-4b4a-b8d1-76e2e139697b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031575 Jul 18 17:24:16.934780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1140/1939] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:24:16.946891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a1ee07b6-fae5-4454-8162-8acda788d67a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:16.946891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a1ee07b6-fae5-4454-8162-8acda788d67a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:16.946891 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1ee07b6-fae5-4454-8162-8acda788d67a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:16.947340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1ee07b6-fae5-4454-8162-8acda788d67a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:16.948123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1ee07b6-fae5-4454-8162-8acda788d67a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:16.948565 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1ee07b6-fae5-4454-8162-8acda788d67a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:16.978468 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a1ee07b6-fae5-4454-8162-8acda788d67a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Jul 18 17:24:16.979264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1141/1940] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:24:16 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:24:17.433442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:17.434103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:17.441883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:17.442327 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:17.443099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:17.443556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:17.584448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:17.592932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:17.594521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:17.595711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2b3f3ceb-9ec4-43c2-9e75-e8fbb368b756 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.166318 Jul 18 17:24:17.596471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1142/1941] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:17 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:17.990947 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a87a62f8-9dae-4bee-8201-847573d04aae tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:17.992176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a87a62f8-9dae-4bee-8201-847573d04aae tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:18.000335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a87a62f8-9dae-4bee-8201-847573d04aae tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:18.000797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a87a62f8-9dae-4bee-8201-847573d04aae tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:18.001569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a87a62f8-9dae-4bee-8201-847573d04aae tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:18.002010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a87a62f8-9dae-4bee-8201-847573d04aae tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:18.030932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a87a62f8-9dae-4bee-8201-847573d04aae tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Jul 18 17:24:18.032017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1143/1942] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:24:17 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:24:18.614669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:18.615296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:18.621846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:18.622287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:18.623102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:18.623631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:18.762092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:18.769940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:18.771444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:18.772607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6467d033-63d3-446e-b09f-21057cd3422b tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.161910 Jul 18 17:24:18.773147 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1144/1943] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:18 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:24:19.042968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b91260e5-b591-49b0-a2fe-5f89d6fbce86 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:19.043825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b91260e5-b591-49b0-a2fe-5f89d6fbce86 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:19.051390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b91260e5-b591-49b0-a2fe-5f89d6fbce86 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:19.052132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b91260e5-b591-49b0-a2fe-5f89d6fbce86 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:19.052914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b91260e5-b591-49b0-a2fe-5f89d6fbce86 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:19.053352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b91260e5-b591-49b0-a2fe-5f89d6fbce86 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:19.099415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b91260e5-b591-49b0-a2fe-5f89d6fbce86 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060205 Jul 18 17:24:19.104255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1145/1944] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:24:19 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:24:19.790658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:19.791316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:19.798550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:19.801652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:19.801652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:19.801652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:20.030631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:20.039716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:20.041424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:20.042814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fd9071fd-df3d-480e-baef-0586d13772a8 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.256077 Jul 18 17:24:20.043369 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1146/1945] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:19 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:24:20.111651 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6bceba25-82da-4cc1-a239-87b8640ef22a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:20.112867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6bceba25-82da-4cc1-a239-87b8640ef22a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:20.119371 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bceba25-82da-4cc1-a239-87b8640ef22a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:20.119869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bceba25-82da-4cc1-a239-87b8640ef22a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:20.120700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bceba25-82da-4cc1-a239-87b8640ef22a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:20.121132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bceba25-82da-4cc1-a239-87b8640ef22a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:20.150650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6bceba25-82da-4cc1-a239-87b8640ef22a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043896 Jul 18 17:24:20.151124 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1147/1946] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:24:20 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 17:24:20.161036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:20.161597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:20.167945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:20.168388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:20.169140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:20.169572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:20.246925 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] HTTP exception thrown: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 is not attached to volume dd3681b3-8cbd-4e43-90c3-f51a6936954e Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Request method failure captured: Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments/dd3681b3-8cbd-4e43-90c3-f51a6936954e HTTP/1.1 Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Za94Yct1C6qUyH-Rs0EpyxY8YKfWJYMFoOAQKStBINb2zjY8MF_E9rPWzPqKkLAaDUsn4xx7cDnKsJmwnOAcZNS8SRo05Ty2wxdLioKItF6FOIlyG8quSE_WAH1OUoy45qpWn_Tr__lI5p1lMMWrtThxK3vt4EcadgI8au5y9rtESo Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 0d565c1992f5420fa5166d2cfb6f1ab2 Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-TestMinimumBasicScenario-1017914110 Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:24:20.259416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d565c1992f5420fa5166d2cfb6f1ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d565c1992f5420fa5166d2cfb6f1ab2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d565c1992f5420fa5166d2cfb6f1ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d565c1992f5420fa5166d2cfb6f1ab2"}]}] Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-TestMinimumBasicScenario-1017914110 Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 0d565c1992f5420fa5166d2cfb6f1ab2 Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1017914110 Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-TestMinimumBasicScenario-1017914110-project Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a6ebcad94c6048c8b174cfcee63a15a7 Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-TestMinimumBasicScenario-1017914110-project Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:24:20.261397 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 is not attached to volume dd3681b3-8cbd-4e43-90c3-f51a6936954e Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'server_id': '51e4933a-4b2e-4f87-ac28-1de0ece7e8f4', 'id': 'dd3681b3-8cbd-4e43-90c3-f51a6936954e'} Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dd3681b3-8cbd-4e43-90c3-f51a6936954e. Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:24:20.262357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 is not attached to volume dd3681b3-8cbd-4e43-90c3-f51a6936954e Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 is not attached to volume dd3681b3-8cbd-4e43-90c3-f51a6936954e Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:20.264321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Returning 404 to user: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 is not attached to volume dd3681b3-8cbd-4e43-90c3-f51a6936954e {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:24:20.265717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6250077d-2d73-42e4-b96e-19887ec6c25a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "DELETE /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments/dd3681b3-8cbd-4e43-90c3-f51a6936954e" status: 404 len: 154 microversion: 2.1 time: 0.104263 Jul 18 17:24:20.265717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1148/1947] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 17:24:20 2022] DELETE /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4/os-volume_attachments/dd3681b3-8cbd-4e43-90c3-f51a6936954e => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:24:21.061546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:21.062230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:21.068684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:21.069128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:21.069885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:21.070313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:21.199930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:21.208098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:21.209603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:21.210740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2fc08ae7-e55c-4928-a387-853521cbbc08 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.153137 Jul 18 17:24:21.211289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1149/1948] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:21 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:21.564839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fb6999da-ab18-4546-9c58-5a2bb8780c8b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:21.565329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fb6999da-ab18-4546-9c58-5a2bb8780c8b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:21.571197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb6999da-ab18-4546-9c58-5a2bb8780c8b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:21.571681 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb6999da-ab18-4546-9c58-5a2bb8780c8b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:21.572427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb6999da-ab18-4546-9c58-5a2bb8780c8b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:21.572858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fb6999da-ab18-4546-9c58-5a2bb8780c8b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:21.596305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fb6999da-ab18-4546-9c58-5a2bb8780c8b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:24:21.886748 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fb6999da-ab18-4546-9c58-5a2bb8780c8b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "DELETE /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 204 len: 0 microversion: 2.1 time: 0.326071 Jul 18 17:24:21.887335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1150/1949] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:24:21 2022] DELETE /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:24:21.896002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f24c8cb0-ddd4-4eb7-850b-e35417bca99b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:21.896694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f24c8cb0-ddd4-4eb7-850b-e35417bca99b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:21.902661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f24c8cb0-ddd4-4eb7-850b-e35417bca99b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:21.903113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f24c8cb0-ddd4-4eb7-850b-e35417bca99b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:21.903909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f24c8cb0-ddd4-4eb7-850b-e35417bca99b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:21.904353 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f24c8cb0-ddd4-4eb7-850b-e35417bca99b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:21.910004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:24:22.043367 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f24c8cb0-ddd4-4eb7-850b-e35417bca99b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:22.051016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f24c8cb0-ddd4-4eb7-850b-e35417bca99b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1552 microversion: 2.1 time: 0.159252 Jul 18 17:24:22.051684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1151/1950] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:24:21 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:24:22.229442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:22.230078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:22.237488 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:22.237936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:22.238685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:22.239119 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:22.368466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:22.377090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:22.378574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:22.379755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2da12b5d-298b-4cf6-98ee-38dabd292f74 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.154311 Jul 18 17:24:22.380326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1152/1951] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:22 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:22.577404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-0ff4f044-aaa9-43d9-9d24-58a68b75db76 req-e1fae91e-5e43-459e-acb1-470f565edff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132383c1-3fc0-4d92-a338-48eda2dd1592", "name": "network-vif-plugged", "status": "completed", "tag": "163ac153-2186-439d-ac74-66a80aeff440"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:24:22.586019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-0ff4f044-aaa9-43d9-9d24-58a68b75db76 req-e1fae91e-5e43-459e-acb1-470f565edff0 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:22.586460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-0ff4f044-aaa9-43d9-9d24-58a68b75db76 req-e1fae91e-5e43-459e-acb1-470f565edff0 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:22.597319 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-0ff4f044-aaa9-43d9-9d24-58a68b75db76 req-e1fae91e-5e43-459e-acb1-470f565edff0 service nova] Creating event network-vif-plugged:163ac153-2186-439d-ac74-66a80aeff440 for instance 132383c1-3fc0-4d92-a338-48eda2dd1592 on hv-cinder-84617 Jul 18 17:24:22.602078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-0ff4f044-aaa9-43d9-9d24-58a68b75db76 req-e1fae91e-5e43-459e-acb1-470f565edff0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028313 Jul 18 17:24:22.602651 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1153/1952] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:24:23.069837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d50a9935-9fb5-436f-895d-b0d50b43f075 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:23.070482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d50a9935-9fb5-436f-895d-b0d50b43f075 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:23.079778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d50a9935-9fb5-436f-895d-b0d50b43f075 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:23.080231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d50a9935-9fb5-436f-895d-b0d50b43f075 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:23.080993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d50a9935-9fb5-436f-895d-b0d50b43f075 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:23.081436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d50a9935-9fb5-436f-895d-b0d50b43f075 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:23.210772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d50a9935-9fb5-436f-895d-b0d50b43f075 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:23.218320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d50a9935-9fb5-436f-895d-b0d50b43f075 tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1552 microversion: 2.1 time: 0.153020 Jul 18 17:24:23.219431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1154/1953] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:24:23 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:24:23.398149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:23.398796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:23.405255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:23.405709 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:23.407057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:23.407518 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:23.541160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:23.549753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:23.551253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:23.552732 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-30c731a4-4e1e-4969-be6e-87028f81d3d5 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.158560 Jul 18 17:24:23.553273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1155/1954] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:23 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:24.236515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3fc33f4f-558e-4ef5-bd64-3c0f8421b03f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:24.237104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3fc33f4f-558e-4ef5-bd64-3c0f8421b03f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:24.243318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3fc33f4f-558e-4ef5-bd64-3c0f8421b03f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:24.243793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3fc33f4f-558e-4ef5-bd64-3c0f8421b03f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:24.244595 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3fc33f4f-558e-4ef5-bd64-3c0f8421b03f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:24.245054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3fc33f4f-558e-4ef5-bd64-3c0f8421b03f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:24.394618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3fc33f4f-558e-4ef5-bd64-3c0f8421b03f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:24.402153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3fc33f4f-558e-4ef5-bd64-3c0f8421b03f tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1552 microversion: 2.1 time: 0.169743 Jul 18 17:24:24.402724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1156/1955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:24:24 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:24:24.509703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-07487b79-cdb8-421c-8802-a2144cdf3857 req-62b523e4-bf0d-41c7-a48b-07c51dc0d168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51e4933a-4b2e-4f87-ac28-1de0ece7e8f4", "name": "network-vif-deleted", "tag": "6e07037e-4e55-43ac-b4c3-5cdb6509ac0c"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:24:24.518615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-07487b79-cdb8-421c-8802-a2144cdf3857 req-62b523e4-bf0d-41c7-a48b-07c51dc0d168 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:24.519064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-07487b79-cdb8-421c-8802-a2144cdf3857 req-62b523e4-bf0d-41c7-a48b-07c51dc0d168 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:24.530256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-07487b79-cdb8-421c-8802-a2144cdf3857 req-62b523e4-bf0d-41c7-a48b-07c51dc0d168 service nova] Creating event network-vif-deleted:6e07037e-4e55-43ac-b4c3-5cdb6509ac0c for instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 on hv-cinder-84617 Jul 18 17:24:24.535352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-07487b79-cdb8-421c-8802-a2144cdf3857 req-62b523e4-bf0d-41c7-a48b-07c51dc0d168 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029324 Jul 18 17:24:24.535969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1157/1956] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:24:24.571544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:24.572236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:24.578482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:24.579052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:24.579836 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:24.584263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:24.711561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:24.720584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:24.722041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:24.723235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-96276679-dbe4-4a6b-ae77-525c8043f051 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.155714 Jul 18 17:24:24.723839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1158/1957] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:24 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:25.419667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:25.420273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:25.426644 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:25.429447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:25.429447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:25.429447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:25.466246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:25.466705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:25.467165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lazy-loading 'fault' on Instance uuid 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:24:25.515708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ebcad94c6048c8b174cfcee63a15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d565c1992f5420fa5166d2cfb6f1ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:25.520815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dbfaf9a3-ef12-48e1-82bc-7eda2cc94d1c tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 200 len: 1348 microversion: 2.1 time: 0.105227 Jul 18 17:24:25.521544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1159/1958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:24:25 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:24:25.741260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:25.741868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:25.743930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:24:25.749113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:25.750669 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:25.751143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:25.751571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:25.892981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:25.905441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:25.907261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:25.908481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2f5ffb2e-c15d-48f3-a1c9-1c87fb1001fb tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1731 microversion: 2.20 time: 0.171146 Jul 18 17:24:25.909380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1160/1959] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:25 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:24:26.539635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:26.540307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [instance: 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:26.547771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:26.548352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:26.549139 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:26.549583 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:26.564366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] HTTP exception thrown: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 could not be found. Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Request method failure captured: Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 HTTP/1.1 Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Za94Yct1C6qUyH-Rs0EpyxY8YKfWJYMFoOAQKStBINb2zjY8MF_E9rPWzPqKkLAaDUsn4xx7cDnKsJmwnOAcZNS8SRo05Ty2wxdLioKItF6FOIlyG8quSE_WAH1OUoy45qpWn_Tr__lI5p1lMMWrtThxK3vt4EcadgI8au5y9rtESo Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 0d565c1992f5420fa5166d2cfb6f1ab2 Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-TestMinimumBasicScenario-1017914110 Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:24:26.566839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d565c1992f5420fa5166d2cfb6f1ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d565c1992f5420fa5166d2cfb6f1ab2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d565c1992f5420fa5166d2cfb6f1ab2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d565c1992f5420fa5166d2cfb6f1ab2"}]}] Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-TestMinimumBasicScenario-1017914110 Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 0d565c1992f5420fa5166d2cfb6f1ab2 Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1017914110 Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-TestMinimumBasicScenario-1017914110-project Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a6ebcad94c6048c8b174cfcee63a15a7 Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-TestMinimumBasicScenario-1017914110-project Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 could not be found. Jul 18 17:24:26.568730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '51e4933a-4b2e-4f87-ac28-1de0ece7e8f4'} Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 could not be found. Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:24:26.569675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 could not be found. Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 could not be found. Jul 18 17:24:26.571217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:24:26.573578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Returning 404 to user: Instance 51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:24:26.573578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ce09d380-257e-4047-a121-71f3b82fc27a tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4" status: 404 len: 111 microversion: 2.1 time: 0.033867 Jul 18 17:24:26.573578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1161/1960] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:24:26 2022] GET /compute/v2.1/servers/51e4933a-4b2e-4f87-ac28-1de0ece7e8f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:24:26.577598 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-343824a2-a5e4-4857-a454-964284a3f36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] Calling method '.version_select at 0x7fd6ae0ff040>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:26.585279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR oslo.messaging._drivers.impl_rabbit [None req-343824a2-a5e4-4857-a454-964284a3f36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [f99f2105-212d-4617-b1e2-17b79206be62] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 17:24:27.588567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [None req-343824a2-a5e4-4857-a454-964284a3f36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] [f99f2105-212d-4617-b1e2-17b79206be62] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 35152. Jul 18 17:24:27.687848 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-343824a2-a5e4-4857-a454-964284a3f36b tempest-TestMinimumBasicScenario-1017914110 tempest-TestMinimumBasicScenario-1017914110-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1824475531" status: 202 len: 0 microversion: 2.1 time: 1.113671 Jul 18 17:24:27.688379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1162/1961] 10.222.0.26 () {58 vars in 1271 bytes} [Mon Jul 18 17:24:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1824475531 => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:24:27.693329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:27.695904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:27.700344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:27.700799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:27.701569 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:27.702006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:27.839997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:27.848419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:27.849982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:27.851138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d57be458-c5ea-49d7-bf21-1f71a223b44a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1718 microversion: 2.20 time: 0.161844 Jul 18 17:24:27.851707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1163/1962] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:27 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 17:24:43.885689 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:24:43.886643 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:24:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:24:50.591006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:24:50.592431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=61 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:24:50.803208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1783f941-67ee-4893-9e41-83cfae032180 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Action: 'create', calling method: .version_select at 0x7fd6afcecf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2096064368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv+1HIjvXOI/nvdjsu9eUuJaGRFLuE69LX4/3kSgyOWRHRjFuE7vGvVVxi5swstMnG0jvXD5DIWqJB0CaxiEARwQ2w3veUKOCzqXz3ST4GWg8MbqSOxNV5bBypOM+knGA=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:24:50.817933 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-1783f941-67ee-4893-9e41-83cfae032180 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Getting quotas for project e4afeb76581942e4a0d72e4568907201. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:24:50.821861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-1783f941-67ee-4893-9e41-83cfae032180 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Getting quotas for user e1fc02859caf4ac09a85a4e5f962c14b and project e4afeb76581942e4a0d72e4568907201. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:24:50.899908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1783f941-67ee-4893-9e41-83cfae032180 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.318315 Jul 18 17:24:50.900515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1164/1963] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 17:24:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:24:59.392953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c160865c-4b9d-4d5f-a6da-02f426f9145d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:59.393867 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c160865c-4b9d-4d5f-a6da-02f426f9145d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:59.399943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c160865c-4b9d-4d5f-a6da-02f426f9145d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:59.400394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c160865c-4b9d-4d5f-a6da-02f426f9145d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:59.401161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c160865c-4b9d-4d5f-a6da-02f426f9145d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:59.401677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c160865c-4b9d-4d5f-a6da-02f426f9145d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:59.432117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c160865c-4b9d-4d5f-a6da-02f426f9145d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043663 Jul 18 17:24:59.432587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1165/1964] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jul 18 17:24:59 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:24:59.490173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e4d6b258-54af-412c-a3ec-20c5896fb227 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:59.490699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e4d6b258-54af-412c-a3ec-20c5896fb227 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:59.496935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e4d6b258-54af-412c-a3ec-20c5896fb227 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:59.497389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e4d6b258-54af-412c-a3ec-20c5896fb227 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:59.498161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e4d6b258-54af-412c-a3ec-20c5896fb227 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:59.498600 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e4d6b258-54af-412c-a3ec-20c5896fb227 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:59.523877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e4d6b258-54af-412c-a3ec-20c5896fb227 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:24:59.830212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e4d6b258-54af-412c-a3ec-20c5896fb227 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "DELETE /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 204 len: 0 microversion: 2.20 time: 0.343011 Jul 18 17:24:59.830791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1166/1965] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 18 17:24:59 2022] DELETE /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 17:24:59.841434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:24:59.842091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:24:59.848970 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:59.849427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:59.850231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:24:59.850649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:24:59.987343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:59.995556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:59.997056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:24:59.998255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8c214ee4-bf3c-427c-ad01-3303b9fb032c tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.162605 Jul 18 17:24:59.998818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1167/1966] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:24:59 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:25:01.017416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:01.018725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:01.021230 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:25:01.026153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:01.026609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:01.027373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:01.027844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:01.162019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:01.169792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:01.171262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:01.172416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-69178241-7eba-4d22-ae63-38a79d302e18 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1724 microversion: 2.20 time: 0.159147 Jul 18 17:25:01.172962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1168/1967] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:25:01 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:25:02.192614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:02.193383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:02.199729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:02.200201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:02.200987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:02.201460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:02.282892 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:02.292136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:02.293652 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aec7436e3a549018fd7892969870019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bad1610198d4b8aacfafc8c92dc7e6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:02.295017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-59ba9176-ed78-4d55-b5ae-034da58c5b89 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 200 len: 1656 microversion: 2.20 time: 0.106791 Jul 18 17:25:02.295594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1169/1968] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:25:02 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 1656 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 17:25:02.474283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-33661408-1e6f-4a1b-a84c-d6baf65815ad req-00f7aafe-21bc-4a29-9754-74ebb5ad1097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132383c1-3fc0-4d92-a338-48eda2dd1592", "name": "network-vif-deleted", "tag": "163ac153-2186-439d-ac74-66a80aeff440"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:02.482475 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-33661408-1e6f-4a1b-a84c-d6baf65815ad req-00f7aafe-21bc-4a29-9754-74ebb5ad1097 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:02.489266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-33661408-1e6f-4a1b-a84c-d6baf65815ad req-00f7aafe-21bc-4a29-9754-74ebb5ad1097 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:02.496295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-33661408-1e6f-4a1b-a84c-d6baf65815ad req-00f7aafe-21bc-4a29-9754-74ebb5ad1097 service nova] Creating event network-vif-deleted:163ac153-2186-439d-ac74-66a80aeff440 for instance 132383c1-3fc0-4d92-a338-48eda2dd1592 on hv-cinder-84617 Jul 18 17:25:02.506423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-33661408-1e6f-4a1b-a84c-d6baf65815ad req-00f7aafe-21bc-4a29-9754-74ebb5ad1097 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036218 Jul 18 17:25:02.507061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1170/1969] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:25:03.316102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:03.316862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:03.326999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:03.326999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:03.326999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:03.326999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:03.340280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] HTTP exception thrown: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Request method failure captured: Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 HTTP/1.1 Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1ZULWQSjXdKtHDWk4NRZaFpOSF5vjIuo6OpqbGDie83TnfOo1yd0-GenbQK9yDtakehP1M3jhBvIYOAo-6fEL7elJY1ANWeth-mgSW7HATwVD3ek3KhONJ3yen5Bsvdu4J0YAdTNMVqX0vU2QHedRtTVtyE2TowWOKAhQJyDTiIIQc0 Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:25:03.341951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1bad1610198d4b8aacfafc8c92dc7e6d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}] Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 9aec7436e3a549018fd7892969870019 Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:03.346076 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '132383c1-3fc0-4d92-a338-48eda2dd1592'} Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:25:03.347170 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:03.349204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:03.350814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Returning 404 to user: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:25:03.350814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-36436c68-3e02-4e80-83d5-09d7288e7e4d tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 404 len: 111 microversion: 2.20 time: 0.032898 Jul 18 17:25:03.350814 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1171/1970] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:25:03 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:25:03.352841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-68660901-699a-462f-862a-5a9bf2d4f8ef tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '.version_select at 0x7fd6ae0ff790>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:03.444365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-68660901-699a-462f-862a-5a9bf2d4f8ef tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227968768" status: 204 len: 0 microversion: 2.20 time: 0.095309 Jul 18 17:25:03.445081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1172/1971] 10.222.0.26 () {60 vars in 1261 bytes} [Mon Jul 18 17:25:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227968768 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 17:25:05.518141 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:05.519364 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:05.527329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:05.527820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:05.528585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:05.529071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:05.543887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] HTTP exception thrown: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Request method failure captured: Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 HTTP/1.1 Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1ZULWQSjXdKtHDWk4NRZaFpOSF5vjIuo6OpqbGDie83TnfOo1yd0-GenbQK9yDtakehP1M3jhBvIYOAo-6fEL7elJY1ANWeth-mgSW7HATwVD3ek3KhONJ3yen5Bsvdu4J0YAdTNMVqX0vU2QHedRtTVtyE2TowWOKAhQJyDTiIIQc0 Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:25:05.545580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1bad1610198d4b8aacfafc8c92dc7e6d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}] Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 9aec7436e3a549018fd7892969870019 Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.547482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '132383c1-3fc0-4d92-a338-48eda2dd1592'} Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:25:05.548568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.550448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.552033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Returning 404 to user: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:25:05.552033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-81c38641-e1a8-4421-960f-b9b925e9dc6a tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "DELETE /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 404 len: 111 microversion: 2.20 time: 0.034175 Jul 18 17:25:05.552033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1173/1972] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 18 17:25:05 2022] DELETE /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:25:05.556586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:05.557189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: 132383c1-3fc0-4d92-a338-48eda2dd1592] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:05.563284 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:05.563770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:05.564691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:05.565264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:05.579048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] HTTP exception thrown: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Request method failure captured: Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 HTTP/1.1 Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1ZULWQSjXdKtHDWk4NRZaFpOSF5vjIuo6OpqbGDie83TnfOo1yd0-GenbQK9yDtakehP1M3jhBvIYOAo-6fEL7elJY1ANWeth-mgSW7HATwVD3ek3KhONJ3yen5Bsvdu4J0YAdTNMVqX0vU2QHedRtTVtyE2TowWOKAhQJyDTiIIQc0 Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:25:05.581116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1bad1610198d4b8aacfafc8c92dc7e6d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}] Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 9aec7436e3a549018fd7892969870019 Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.582924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '132383c1-3fc0-4d92-a338-48eda2dd1592'} Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:25:05.583957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. Jul 18 17:25:05.585574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:05.587038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Returning 404 to user: Instance 132383c1-3fc0-4d92-a338-48eda2dd1592 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:25:05.587038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-18325e15-fb77-4486-8b72-72f1ac8266f0 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592" status: 404 len: 111 microversion: 2.20 time: 0.029876 Jul 18 17:25:05.587038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1174/1973] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:25:05 2022] GET /compute/v2.1/servers/132383c1-3fc0-4d92-a338-48eda2dd1592 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:25:06.852413 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:06.852992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:06.859337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:06.859824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:06.860580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:06.861019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:06.874842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] HTTP exception thrown: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Request method failure captured: Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 HTTP/1.1 Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1ZULWQSjXdKtHDWk4NRZaFpOSF5vjIuo6OpqbGDie83TnfOo1yd0-GenbQK9yDtakehP1M3jhBvIYOAo-6fEL7elJY1ANWeth-mgSW7HATwVD3ek3KhONJ3yen5Bsvdu4J0YAdTNMVqX0vU2QHedRtTVtyE2TowWOKAhQJyDTiIIQc0 Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:25:06.876416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1bad1610198d4b8aacfafc8c92dc7e6d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}] Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 9aec7436e3a549018fd7892969870019 Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.878217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'ca39c53c-f52f-441d-b279-67c345389ce4'} Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:25:06.879045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.880431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.881861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Returning 404 to user: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:25:06.881861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fdb35b81-3ec1-4e03-abf3-6c7c178ce463 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 404 len: 111 microversion: 2.20 time: 0.029423 Jul 18 17:25:06.881861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1175/1974] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jul 18 17:25:06 2022] DELETE /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:25:06.885779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:06.886373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] [instance: ca39c53c-f52f-441d-b279-67c345389ce4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:06.892054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:06.892545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:06.893300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:06.893741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:06.906611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] HTTP exception thrown: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Request method failure captured: Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 HTTP/1.1 Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1ZULWQSjXdKtHDWk4NRZaFpOSF5vjIuo6OpqbGDie83TnfOo1yd0-GenbQK9yDtakehP1M3jhBvIYOAo-6fEL7elJY1ANWeth-mgSW7HATwVD3ek3KhONJ3yen5Bsvdu4J0YAdTNMVqX0vU2QHedRtTVtyE2TowWOKAhQJyDTiIIQc0 Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:25:06.908667 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1bad1610198d4b8aacfafc8c92dc7e6d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1bad1610198d4b8aacfafc8c92dc7e6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1bad1610198d4b8aacfafc8c92dc7e6d"}]}] Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 1bad1610198d4b8aacfafc8c92dc7e6d Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-858546901 Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: 9aec7436e3a549018fd7892969870019 Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeShelveTestJSON-858546901-project Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.910482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'ca39c53c-f52f-441d-b279-67c345389ce4'} Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:25:06.911546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. Jul 18 17:25:06.913173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:25:06.914731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] Returning 404 to user: Instance ca39c53c-f52f-441d-b279-67c345389ce4 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:25:06.914731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-af22c2a2-921b-49a3-be8c-e1e0c3b3f7f2 tempest-AttachVolumeShelveTestJSON-858546901 tempest-AttachVolumeShelveTestJSON-858546901-project] 10.222.0.26 "GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4" status: 404 len: 111 microversion: 2.20 time: 0.027689 Jul 18 17:25:06.914731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1176/1975] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jul 18 17:25:06 2022] GET /compute/v2.1/servers/ca39c53c-f52f-441d-b279-67c345389ce4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:25:08.995421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1967226065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2096064368", "security_groups": [{"name": "tempest-secgroup-smoke-285184171"}], "block_device_mapping_v2": [{"uuid": "01205a0e-3d4b-43b9-a2dd-89940e12dd7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba382ac1-9c33-468c-acb2-a793dc60447f"}]}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:09.109154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] validate_networks() for [('ba382ac1-9c33-468c-acb2-a793dc60447f', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:25:09.528394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:25:09.528815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:25:09.529279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:25:09.529683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:25:09.530088 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:25:09.539760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:09.540210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:09.541140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:09.541572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:09.558320 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Getting quotas for project e4afeb76581942e4a0d72e4568907201. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:25:09.562217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Getting quotas for user e1fc02859caf4ac09a85a4e5f962c14b and project e4afeb76581942e4a0d72e4568907201. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:25:09.620768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:25:09.622962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01205a0e-3d4b-43b9-a2dd-89940e12dd7f',volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:25:10.143087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-df7a7d14-e9d1-46c7-9ed3-861d0b624173 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.151031 Jul 18 17:25:10.143798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1177/1976] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:25:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 17:25:10.158984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c92e83c8-8687-41bb-91a6-308d3697b929 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:10.164742 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c92e83c8-8687-41bb-91a6-308d3697b929 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:10.242173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c92e83c8-8687-41bb-91a6-308d3697b929 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:10.249427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c92e83c8-8687-41bb-91a6-308d3697b929 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1095 microversion: 2.1 time: 0.096675 Jul 18 17:25:10.250009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1178/1977] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:10 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:25:11.266581 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ecc8771f-de76-414b-bfda-40f8c864e6c7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:11.267271 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ecc8771f-de76-414b-bfda-40f8c864e6c7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:11.274378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecc8771f-de76-414b-bfda-40f8c864e6c7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:11.274818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecc8771f-de76-414b-bfda-40f8c864e6c7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:11.275625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecc8771f-de76-414b-bfda-40f8c864e6c7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:11.276058 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecc8771f-de76-414b-bfda-40f8c864e6c7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:11.354578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ecc8771f-de76-414b-bfda-40f8c864e6c7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:11.354578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ecc8771f-de76-414b-bfda-40f8c864e6c7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1145 microversion: 2.1 time: 0.086056 Jul 18 17:25:11.354578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1179/1978] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:11 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:12.368703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ee9913c1-40d8-4eb5-801c-77c1fd74b877 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:12.369357 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ee9913c1-40d8-4eb5-801c-77c1fd74b877 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:12.376165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ee9913c1-40d8-4eb5-801c-77c1fd74b877 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:12.376676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ee9913c1-40d8-4eb5-801c-77c1fd74b877 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:12.377787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ee9913c1-40d8-4eb5-801c-77c1fd74b877 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:12.378218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ee9913c1-40d8-4eb5-801c-77c1fd74b877 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:12.466284 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ee9913c1-40d8-4eb5-801c-77c1fd74b877 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:12.475754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ee9913c1-40d8-4eb5-801c-77c1fd74b877 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1201 microversion: 2.1 time: 0.110890 Jul 18 17:25:12.476517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1180/1979] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:12 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1201 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:13.493751 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-39291ad2-6bfb-491e-97ca-1dbf4d720852 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:13.494615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-39291ad2-6bfb-491e-97ca-1dbf4d720852 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:13.501055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-39291ad2-6bfb-491e-97ca-1dbf4d720852 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:13.501509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-39291ad2-6bfb-491e-97ca-1dbf4d720852 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:13.503126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-39291ad2-6bfb-491e-97ca-1dbf4d720852 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:13.503778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-39291ad2-6bfb-491e-97ca-1dbf4d720852 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:13.763347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-39291ad2-6bfb-491e-97ca-1dbf4d720852 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:13.771783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-39291ad2-6bfb-491e-97ca-1dbf4d720852 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1278 microversion: 2.1 time: 0.281900 Jul 18 17:25:13.772358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1181/1980] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:13 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:14.411120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-d54a512e-1c5e-4833-8913-36f3a10d7291 req-251879ed-2010-4a3c-9f35-e10313f0fdfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db020acd-c5ee-48df-9832-c5a270c4e9b4", "tag": "ad2677ec-4fff-4983-a4e7-ce060544d5e9"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:14.424483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d54a512e-1c5e-4833-8913-36f3a10d7291 req-251879ed-2010-4a3c-9f35-e10313f0fdfb service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:14.425148 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d54a512e-1c5e-4833-8913-36f3a10d7291 req-251879ed-2010-4a3c-9f35-e10313f0fdfb service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:14.444379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-d54a512e-1c5e-4833-8913-36f3a10d7291 req-251879ed-2010-4a3c-9f35-e10313f0fdfb service nova] Creating event network-changed:ad2677ec-4fff-4983-a4e7-ce060544d5e9 for instance db020acd-c5ee-48df-9832-c5a270c4e9b4 on hv-cinder-84617 Jul 18 17:25:14.452811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-d54a512e-1c5e-4833-8913-36f3a10d7291 req-251879ed-2010-4a3c-9f35-e10313f0fdfb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044918 Jul 18 17:25:14.454430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1182/1981] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:25:14.793225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ab766d29-9c4e-439a-9029-4a0fbb4e4499 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:14.794165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ab766d29-9c4e-439a-9029-4a0fbb4e4499 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:14.801923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ab766d29-9c4e-439a-9029-4a0fbb4e4499 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:14.802634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ab766d29-9c4e-439a-9029-4a0fbb4e4499 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:14.803990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ab766d29-9c4e-439a-9029-4a0fbb4e4499 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:14.804594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ab766d29-9c4e-439a-9029-4a0fbb4e4499 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:15.091716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ab766d29-9c4e-439a-9029-4a0fbb4e4499 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:15.100793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ab766d29-9c4e-439a-9029-4a0fbb4e4499 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.313527 Jul 18 17:25:15.101570 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1183/1982] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:14 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:25:16.117875 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ed6e80d9-3ff9-428b-9b39-0c49e971e9a7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:16.118514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ed6e80d9-3ff9-428b-9b39-0c49e971e9a7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:16.124999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed6e80d9-3ff9-428b-9b39-0c49e971e9a7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:16.125492 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed6e80d9-3ff9-428b-9b39-0c49e971e9a7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:16.126255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed6e80d9-3ff9-428b-9b39-0c49e971e9a7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:16.127942 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed6e80d9-3ff9-428b-9b39-0c49e971e9a7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:16.270443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ed6e80d9-3ff9-428b-9b39-0c49e971e9a7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:16.278439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ed6e80d9-3ff9-428b-9b39-0c49e971e9a7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.164301 Jul 18 17:25:16.279890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1184/1983] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:16 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:17.296261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bbdfe2bc-4aec-42b7-90ba-c6c510e61fb4 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:17.296874 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bbdfe2bc-4aec-42b7-90ba-c6c510e61fb4 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:17.304796 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2bc-4aec-42b7-90ba-c6c510e61fb4 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:17.305241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2bc-4aec-42b7-90ba-c6c510e61fb4 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:17.305997 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2bc-4aec-42b7-90ba-c6c510e61fb4 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:17.306430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bbdfe2bc-4aec-42b7-90ba-c6c510e61fb4 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:17.454175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bbdfe2bc-4aec-42b7-90ba-c6c510e61fb4 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:17.463137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bbdfe2bc-4aec-42b7-90ba-c6c510e61fb4 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.170726 Jul 18 17:25:17.463743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1185/1984] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:17 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:18.180542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c6064f1e-144e-4b66-8485-e19f72b6e627 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: .version_select at 0x7fd6ae360ca0>, body: {"keypair": {"name": "tempest-keypair-989056327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4P63DFP4iqEuB70MhdsrWjF6s4faZTbXOMok6MgrmuXaQwYs0FPr7kLxHLnkxRqt8Ld6FfCLm7Rc8P6Ynsx2Zg2N8VMoQN8tSJsPvbfUlLISsFES8Sp+BPzv2HD7QjCg=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:18.196550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-c6064f1e-144e-4b66-8485-e19f72b6e627 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for project 60611329802847dd9da7d4d230ab32a4. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:25:18.200983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-c6064f1e-144e-4b66-8485-e19f72b6e627 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for user a708e1f37fd5453198e32ec6427afcaa and project 60611329802847dd9da7d4d230ab32a4. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:25:18.469567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c6064f1e-144e-4b66-8485-e19f72b6e627 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.414843 Jul 18 17:25:18.497377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1186/1985] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 17:25:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:25:18.497377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6454f2ca-fce0-4e9c-8a30-1fc2a822a819 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:18.497377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6454f2ca-fce0-4e9c-8a30-1fc2a822a819 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:18.497377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6454f2ca-fce0-4e9c-8a30-1fc2a822a819 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:18.497377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6454f2ca-fce0-4e9c-8a30-1fc2a822a819 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:18.498409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6454f2ca-fce0-4e9c-8a30-1fc2a822a819 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:18.498514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6454f2ca-fce0-4e9c-8a30-1fc2a822a819 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:18.663343 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6454f2ca-fce0-4e9c-8a30-1fc2a822a819 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:18.671798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6454f2ca-fce0-4e9c-8a30-1fc2a822a819 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.191381 Jul 18 17:25:18.678646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1187/1986] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:18 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:19.689109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-12cc3e07-7fa3-475a-acd7-657408c1597a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:19.689841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-12cc3e07-7fa3-475a-acd7-657408c1597a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:19.693063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:25:19.698311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12cc3e07-7fa3-475a-acd7-657408c1597a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:19.698763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12cc3e07-7fa3-475a-acd7-657408c1597a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:19.699558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12cc3e07-7fa3-475a-acd7-657408c1597a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:19.700008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12cc3e07-7fa3-475a-acd7-657408c1597a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:19.704258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:25:19.858689 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-12cc3e07-7fa3-475a-acd7-657408c1597a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:19.866750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-12cc3e07-7fa3-475a-acd7-657408c1597a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.181527 Jul 18 17:25:19.867588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1188/1987] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:19 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:20.884725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1816e1d5-1839-4d65-a666-935ecff40431 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:20.885594 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1816e1d5-1839-4d65-a666-935ecff40431 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:20.887964 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:25:20.892986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1816e1d5-1839-4d65-a666-935ecff40431 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:20.893451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1816e1d5-1839-4d65-a666-935ecff40431 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:20.894360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1816e1d5-1839-4d65-a666-935ecff40431 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:20.894792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1816e1d5-1839-4d65-a666-935ecff40431 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:21.055467 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1816e1d5-1839-4d65-a666-935ecff40431 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:21.065694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1816e1d5-1839-4d65-a666-935ecff40431 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.184346 Jul 18 17:25:21.066959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1189/1988] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:20 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:25:21.216526 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-585250600", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d93bdb0-53cc-4bb1-8136-c043e0adfbdb"}], "security_groups": [{"name": "tempest-securitygroup--186527114"}], "key_name": "tempest-keypair-989056327", "user_data": "}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:21.328477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] validate_networks() for [('7d93bdb0-53cc-4bb1-8136-c043e0adfbdb', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:25:21.726708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:25:21.731856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:25:21.731856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:25:21.731856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:25:21.731856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:25:21.745038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:21.745491 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:21.746267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:21.746698 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:21.765207 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for project 60611329802847dd9da7d4d230ab32a4. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:25:21.770394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for user a708e1f37fd5453198e32ec6427afcaa and project 60611329802847dd9da7d4d230ab32a4. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:25:21.784350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:25:21.786697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:25:21.930955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-77023a0b-0d36-42c0-b8c6-bdb9d2273ba5 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.719272 Jul 18 17:25:21.932514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1190/1989] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:25:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:25:21.943910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b7db48c9-a11a-4041-89ea-bb6ede39efce tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:21.944922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b7db48c9-a11a-4041-89ea-bb6ede39efce tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:22.003703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b7db48c9-a11a-4041-89ea-bb6ede39efce tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:22.017462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b7db48c9-a11a-4041-89ea-bb6ede39efce tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1240 microversion: 2.1 time: 0.076606 Jul 18 17:25:22.017462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1191/1990] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:21 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:22.082507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bb684fc9-8ddc-4718-9092-e573088b65aa tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:22.083113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bb684fc9-8ddc-4718-9092-e573088b65aa tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:22.089935 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb684fc9-8ddc-4718-9092-e573088b65aa tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:22.090393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb684fc9-8ddc-4718-9092-e573088b65aa tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:22.091164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb684fc9-8ddc-4718-9092-e573088b65aa tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:22.091785 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb684fc9-8ddc-4718-9092-e573088b65aa tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:22.229694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bb684fc9-8ddc-4718-9092-e573088b65aa tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:22.237232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bb684fc9-8ddc-4718-9092-e573088b65aa tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.158860 Jul 18 17:25:22.237830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1192/1991] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:22 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:23.032773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3b120708-ff1d-4502-b58c-051a1b228a2f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:23.033443 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3b120708-ff1d-4502-b58c-051a1b228a2f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:23.040031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b120708-ff1d-4502-b58c-051a1b228a2f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:23.040478 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b120708-ff1d-4502-b58c-051a1b228a2f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:23.041556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b120708-ff1d-4502-b58c-051a1b228a2f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:23.041998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3b120708-ff1d-4502-b58c-051a1b228a2f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:23.121484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3b120708-ff1d-4502-b58c-051a1b228a2f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:23.129524 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3b120708-ff1d-4502-b58c-051a1b228a2f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1244 microversion: 2.1 time: 0.100803 Jul 18 17:25:23.130087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1193/1992] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:23 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:23.255254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ecf22dfe-b9cf-4d3c-9f25-f5cb0bb033f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:23.255899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ecf22dfe-b9cf-4d3c-9f25-f5cb0bb033f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:23.261916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecf22dfe-b9cf-4d3c-9f25-f5cb0bb033f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:23.262366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecf22dfe-b9cf-4d3c-9f25-f5cb0bb033f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:23.263123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecf22dfe-b9cf-4d3c-9f25-f5cb0bb033f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:23.263586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ecf22dfe-b9cf-4d3c-9f25-f5cb0bb033f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:23.415115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ecf22dfe-b9cf-4d3c-9f25-f5cb0bb033f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:23.423465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ecf22dfe-b9cf-4d3c-9f25-f5cb0bb033f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.173176 Jul 18 17:25:23.426303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1194/1993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:23 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:24.146296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-79c52f0c-38f8-49bd-81be-4c01843056bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:24.146984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-79c52f0c-38f8-49bd-81be-4c01843056bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:24.153898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-79c52f0c-38f8-49bd-81be-4c01843056bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:24.154350 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-79c52f0c-38f8-49bd-81be-4c01843056bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:24.155305 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-79c52f0c-38f8-49bd-81be-4c01843056bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:24.155771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-79c52f0c-38f8-49bd-81be-4c01843056bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:24.219812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-79c52f0c-38f8-49bd-81be-4c01843056bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:24.227695 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-79c52f0c-38f8-49bd-81be-4c01843056bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1292 microversion: 2.1 time: 0.085316 Jul 18 17:25:24.228251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1195/1994] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:24 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:24.441416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c7aed9ea-68db-4f2a-81aa-f2e60b1b2452 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:24.442025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c7aed9ea-68db-4f2a-81aa-f2e60b1b2452 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:24.448235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7aed9ea-68db-4f2a-81aa-f2e60b1b2452 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:24.448927 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7aed9ea-68db-4f2a-81aa-f2e60b1b2452 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:24.449690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7aed9ea-68db-4f2a-81aa-f2e60b1b2452 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:24.450158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c7aed9ea-68db-4f2a-81aa-f2e60b1b2452 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:24.620082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c7aed9ea-68db-4f2a-81aa-f2e60b1b2452 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:24.627462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c7aed9ea-68db-4f2a-81aa-f2e60b1b2452 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.190045 Jul 18 17:25:24.628249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1196/1995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:24 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:25.154545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-e34ab57b-af07-463f-a792-a1399248552e req-9958d13b-60f1-49fe-bc9e-2afcfe5b26a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db020acd-c5ee-48df-9832-c5a270c4e9b4", "name": "network-vif-plugged", "status": "completed", "tag": "ad2677ec-4fff-4983-a4e7-ce060544d5e9"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:25.166287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-e34ab57b-af07-463f-a792-a1399248552e req-9958d13b-60f1-49fe-bc9e-2afcfe5b26a0 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:25.166763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-e34ab57b-af07-463f-a792-a1399248552e req-9958d13b-60f1-49fe-bc9e-2afcfe5b26a0 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:25.180062 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-e34ab57b-af07-463f-a792-a1399248552e req-9958d13b-60f1-49fe-bc9e-2afcfe5b26a0 service nova] Creating event network-vif-plugged:ad2677ec-4fff-4983-a4e7-ce060544d5e9 for instance db020acd-c5ee-48df-9832-c5a270c4e9b4 on hv-cinder-84617 Jul 18 17:25:25.185550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-e34ab57b-af07-463f-a792-a1399248552e req-9958d13b-60f1-49fe-bc9e-2afcfe5b26a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035241 Jul 18 17:25:25.192608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1197/1996] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:25:25.245118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8532cb7f-1006-4128-ba97-9e314a857986 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:25.245821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8532cb7f-1006-4128-ba97-9e314a857986 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:25.253177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8532cb7f-1006-4128-ba97-9e314a857986 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:25.253736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8532cb7f-1006-4128-ba97-9e314a857986 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:25.254826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8532cb7f-1006-4128-ba97-9e314a857986 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:25.255217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8532cb7f-1006-4128-ba97-9e314a857986 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:25.723334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8532cb7f-1006-4128-ba97-9e314a857986 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:25.730879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8532cb7f-1006-4128-ba97-9e314a857986 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1365 microversion: 2.1 time: 0.489940 Jul 18 17:25:25.731452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1198/1997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:25 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1365 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:25:25.735882 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b6fec1be-dbbb-4dde-90b9-4339f194faa7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:25.736490 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b6fec1be-dbbb-4dde-90b9-4339f194faa7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:25.744060 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6fec1be-dbbb-4dde-90b9-4339f194faa7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:25.744503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6fec1be-dbbb-4dde-90b9-4339f194faa7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:25.745418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6fec1be-dbbb-4dde-90b9-4339f194faa7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:25.745853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b6fec1be-dbbb-4dde-90b9-4339f194faa7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:25.957961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b6fec1be-dbbb-4dde-90b9-4339f194faa7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:25.966161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b6fec1be-dbbb-4dde-90b9-4339f194faa7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1266 microversion: 2.1 time: 0.233684 Jul 18 17:25:25.967681 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1199/1998] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:25 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:25:26.439258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-816ff2b2-b1c1-4b2a-8956-a55d6a264b38 req-b1ee0d08-34ff-4d58-9d54-c807e560a3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54591214-04e4-4bba-b394-917103e800af", "tag": "968e4710-f261-41c5-8fff-1d5a8e1fa9e7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:26.449685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-816ff2b2-b1c1-4b2a-8956-a55d6a264b38 req-b1ee0d08-34ff-4d58-9d54-c807e560a3ed service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:26.450138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-816ff2b2-b1c1-4b2a-8956-a55d6a264b38 req-b1ee0d08-34ff-4d58-9d54-c807e560a3ed service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:26.465724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-816ff2b2-b1c1-4b2a-8956-a55d6a264b38 req-b1ee0d08-34ff-4d58-9d54-c807e560a3ed service nova] Creating event network-changed:968e4710-f261-41c5-8fff-1d5a8e1fa9e7 for instance 54591214-04e4-4bba-b394-917103e800af on hv-cinder-84617 Jul 18 17:25:26.470658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-816ff2b2-b1c1-4b2a-8956-a55d6a264b38 req-b1ee0d08-34ff-4d58-9d54-c807e560a3ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046111 Jul 18 17:25:26.471251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1200/1999] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:25:26.748517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-61719692-fcc6-47ab-ac3e-ff6e1c41a052 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:26.749206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-61719692-fcc6-47ab-ac3e-ff6e1c41a052 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:26.755771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61719692-fcc6-47ab-ac3e-ff6e1c41a052 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:26.756217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61719692-fcc6-47ab-ac3e-ff6e1c41a052 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:26.757009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61719692-fcc6-47ab-ac3e-ff6e1c41a052 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:26.757428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61719692-fcc6-47ab-ac3e-ff6e1c41a052 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:26.891376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-61719692-fcc6-47ab-ac3e-ff6e1c41a052 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:26.899691 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-61719692-fcc6-47ab-ac3e-ff6e1c41a052 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1365 microversion: 2.1 time: 0.155301 Jul 18 17:25:26.900265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1201/2000] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:26 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:26.982198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3bf32d65-2df1-4ca6-9ee8-920087a92fb9 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:26.982803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3bf32d65-2df1-4ca6-9ee8-920087a92fb9 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:26.989410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3bf32d65-2df1-4ca6-9ee8-920087a92fb9 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:26.989804 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3bf32d65-2df1-4ca6-9ee8-920087a92fb9 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:26.990682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3bf32d65-2df1-4ca6-9ee8-920087a92fb9 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:26.991113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3bf32d65-2df1-4ca6-9ee8-920087a92fb9 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:27.227705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3bf32d65-2df1-4ca6-9ee8-920087a92fb9 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:27.235825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3bf32d65-2df1-4ca6-9ee8-920087a92fb9 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1452 microversion: 2.1 time: 0.257461 Jul 18 17:25:27.238809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1202/2001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:26 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1452 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:27.251911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-29fab8a3-dea5-49f6-8fe4-50e923bee456 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:27.252510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-29fab8a3-dea5-49f6-8fe4-50e923bee456 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:27.259334 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-29fab8a3-dea5-49f6-8fe4-50e923bee456 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:27.259697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-29fab8a3-dea5-49f6-8fe4-50e923bee456 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:27.260448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-29fab8a3-dea5-49f6-8fe4-50e923bee456 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:27.260877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-29fab8a3-dea5-49f6-8fe4-50e923bee456 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:27.436894 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-29fab8a3-dea5-49f6-8fe4-50e923bee456 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:27.445452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-29fab8a3-dea5-49f6-8fe4-50e923bee456 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1452 microversion: 2.1 time: 0.197329 Jul 18 17:25:27.446868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1203/2002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:27 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:27.916983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-88a83232-25f0-4b78-8b62-9e9cbf5f9836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:27.917599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-88a83232-25f0-4b78-8b62-9e9cbf5f9836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:27.924039 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88a83232-25f0-4b78-8b62-9e9cbf5f9836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:27.924491 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88a83232-25f0-4b78-8b62-9e9cbf5f9836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:27.925785 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88a83232-25f0-4b78-8b62-9e9cbf5f9836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:27.926253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-88a83232-25f0-4b78-8b62-9e9cbf5f9836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:28.057736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-88a83232-25f0-4b78-8b62-9e9cbf5f9836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:28.065268 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-88a83232-25f0-4b78-8b62-9e9cbf5f9836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1365 microversion: 2.1 time: 0.152313 Jul 18 17:25:28.065984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1204/2003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:27 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:29.082770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-11bf5543-2cc9-43dc-84bf-23e465ea6a32 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:29.083537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-11bf5543-2cc9-43dc-84bf-23e465ea6a32 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:29.089959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11bf5543-2cc9-43dc-84bf-23e465ea6a32 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:29.090411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11bf5543-2cc9-43dc-84bf-23e465ea6a32 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:29.091176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11bf5543-2cc9-43dc-84bf-23e465ea6a32 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:29.091649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-11bf5543-2cc9-43dc-84bf-23e465ea6a32 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:29.225175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-11bf5543-2cc9-43dc-84bf-23e465ea6a32 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:29.232807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-11bf5543-2cc9-43dc-84bf-23e465ea6a32 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1365 microversion: 2.1 time: 0.154495 Jul 18 17:25:29.233368 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1205/2004] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:29 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:29.433660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-efb3d937-09ca-4d31-80b6-87e737219e3f req-631a92fd-edf7-4abc-a58a-452751111d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db020acd-c5ee-48df-9832-c5a270c4e9b4", "tag": "ad2677ec-4fff-4983-a4e7-ce060544d5e9"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:29.443060 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-efb3d937-09ca-4d31-80b6-87e737219e3f req-631a92fd-edf7-4abc-a58a-452751111d90 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:29.443587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-efb3d937-09ca-4d31-80b6-87e737219e3f req-631a92fd-edf7-4abc-a58a-452751111d90 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:29.454227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-efb3d937-09ca-4d31-80b6-87e737219e3f req-631a92fd-edf7-4abc-a58a-452751111d90 service nova] Creating event network-changed:ad2677ec-4fff-4983-a4e7-ce060544d5e9 for instance db020acd-c5ee-48df-9832-c5a270c4e9b4 on hv-cinder-84617 Jul 18 17:25:29.459712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-efb3d937-09ca-4d31-80b6-87e737219e3f req-631a92fd-edf7-4abc-a58a-452751111d90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029723 Jul 18 17:25:29.460316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1206/2005] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:25:30.250922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4733b715-1e0d-456e-8ab3-6dc20fefd554 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:30.251809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4733b715-1e0d-456e-8ab3-6dc20fefd554 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:30.260066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4733b715-1e0d-456e-8ab3-6dc20fefd554 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:30.260586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4733b715-1e0d-456e-8ab3-6dc20fefd554 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:30.267228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4733b715-1e0d-456e-8ab3-6dc20fefd554 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:30.267228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4733b715-1e0d-456e-8ab3-6dc20fefd554 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:30.401428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4733b715-1e0d-456e-8ab3-6dc20fefd554 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:30.409566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4733b715-1e0d-456e-8ab3-6dc20fefd554 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1365 microversion: 2.1 time: 0.163093 Jul 18 17:25:30.410199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1207/2006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:30 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:31.427304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8da0e167-c178-4019-993c-ca5c3f860528 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:31.428231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8da0e167-c178-4019-993c-ca5c3f860528 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:31.434513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8da0e167-c178-4019-993c-ca5c3f860528 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:31.434969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8da0e167-c178-4019-993c-ca5c3f860528 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:31.435765 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8da0e167-c178-4019-993c-ca5c3f860528 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:31.436203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8da0e167-c178-4019-993c-ca5c3f860528 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:31.454515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:25:31.564665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8da0e167-c178-4019-993c-ca5c3f860528 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:31.572695 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8da0e167-c178-4019-993c-ca5c3f860528 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1365 microversion: 2.1 time: 0.150138 Jul 18 17:25:31.573261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1208/2007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:31 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:32.589977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d444376d-4f23-462a-a51f-f30f64514675 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:32.590615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d444376d-4f23-462a-a51f-f30f64514675 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:32.592456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:25:32.593136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=20 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:25:32.599022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d444376d-4f23-462a-a51f-f30f64514675 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:32.599473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d444376d-4f23-462a-a51f-f30f64514675 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:32.600264 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d444376d-4f23-462a-a51f-f30f64514675 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:32.600694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d444376d-4f23-462a-a51f-f30f64514675 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:32.788782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d444376d-4f23-462a-a51f-f30f64514675 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:32.796239 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d444376d-4f23-462a-a51f-f30f64514675 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1365 microversion: 2.1 time: 0.210555 Jul 18 17:25:32.796798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1209/2008] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:32 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:33.054658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-580fd866-f8df-438f-b51d-3c1123907aa2 req-5ab385de-cb95-4cb9-8529-79f753be11d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54591214-04e4-4bba-b394-917103e800af", "name": "network-vif-plugged", "status": "completed", "tag": "968e4710-f261-41c5-8fff-1d5a8e1fa9e7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:33.062622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-580fd866-f8df-438f-b51d-3c1123907aa2 req-5ab385de-cb95-4cb9-8529-79f753be11d8 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:33.063068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-580fd866-f8df-438f-b51d-3c1123907aa2 req-5ab385de-cb95-4cb9-8529-79f753be11d8 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:33.073831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-580fd866-f8df-438f-b51d-3c1123907aa2 req-5ab385de-cb95-4cb9-8529-79f753be11d8 service nova] Creating event network-vif-plugged:968e4710-f261-41c5-8fff-1d5a8e1fa9e7 for instance 54591214-04e4-4bba-b394-917103e800af on hv-cinder-84617 Jul 18 17:25:33.078660 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-580fd866-f8df-438f-b51d-3c1123907aa2 req-5ab385de-cb95-4cb9-8529-79f753be11d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027870 Jul 18 17:25:33.079312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1210/2009] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:25:33.816711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b0b7e473-3168-4ce2-9e5d-7d6eedcf1c46 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:33.817400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b0b7e473-3168-4ce2-9e5d-7d6eedcf1c46 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:33.824145 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0b7e473-3168-4ce2-9e5d-7d6eedcf1c46 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:33.824584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0b7e473-3168-4ce2-9e5d-7d6eedcf1c46 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:33.825325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0b7e473-3168-4ce2-9e5d-7d6eedcf1c46 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:33.825760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0b7e473-3168-4ce2-9e5d-7d6eedcf1c46 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:33.957477 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b0b7e473-3168-4ce2-9e5d-7d6eedcf1c46 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:33.964880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b0b7e473-3168-4ce2-9e5d-7d6eedcf1c46 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1365 microversion: 2.1 time: 0.154326 Jul 18 17:25:33.965458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1211/2010] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:33 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:34.982219 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-620b11da-6682-4204-baab-33c6ed19b495 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:34.983037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-620b11da-6682-4204-baab-33c6ed19b495 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:34.990109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-620b11da-6682-4204-baab-33c6ed19b495 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:34.990566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-620b11da-6682-4204-baab-33c6ed19b495 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:34.992704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-620b11da-6682-4204-baab-33c6ed19b495 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:34.992704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-620b11da-6682-4204-baab-33c6ed19b495 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:35.139448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-620b11da-6682-4204-baab-33c6ed19b495 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:25:35.147514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-620b11da-6682-4204-baab-33c6ed19b495 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1554 microversion: 2.1 time: 0.169178 Jul 18 17:25:35.148089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1212/2011] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:25:34 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:25:35.163724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-13088d09-6fe9-4191-956e-973b7e9f4f0a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:25:35.164215 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-13088d09-6fe9-4191-956e-973b7e9f4f0a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:25:35.170009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13088d09-6fe9-4191-956e-973b7e9f4f0a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:35.170460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13088d09-6fe9-4191-956e-973b7e9f4f0a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:35.171292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13088d09-6fe9-4191-956e-973b7e9f4f0a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:35.171776 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13088d09-6fe9-4191-956e-973b7e9f4f0a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:35.249943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-13088d09-6fe9-4191-956e-973b7e9f4f0a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089757 Jul 18 17:25:35.250535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1213/2012] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 18 17:25:35 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:25:36.484919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-a624f61d-a7c8-4257-b426-3ce1a19e64dd req-2f61c90e-84e5-46ff-9974-a572aeedfda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54591214-04e4-4bba-b394-917103e800af", "tag": "968e4710-f261-41c5-8fff-1d5a8e1fa9e7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:25:36.494020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-a624f61d-a7c8-4257-b426-3ce1a19e64dd req-2f61c90e-84e5-46ff-9974-a572aeedfda7 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:25:36.494464 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-a624f61d-a7c8-4257-b426-3ce1a19e64dd req-2f61c90e-84e5-46ff-9974-a572aeedfda7 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:25:36.505866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-a624f61d-a7c8-4257-b426-3ce1a19e64dd req-2f61c90e-84e5-46ff-9974-a572aeedfda7 service nova] Creating event network-changed:968e4710-f261-41c5-8fff-1d5a8e1fa9e7 for instance 54591214-04e4-4bba-b394-917103e800af on hv-cinder-84617 Jul 18 17:25:36.511027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-a624f61d-a7c8-4257-b426-3ce1a19e64dd req-2f61c90e-84e5-46ff-9974-a572aeedfda7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029628 Jul 18 17:25:36.511662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1214/2013] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:26:06.609519 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:26:06.609989 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:26:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:26:12.657711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:26:12.659188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=28 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:26:12.663279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9004fed7-2b4f-452b-ba2e-24576c96e81b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:12.663885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9004fed7-2b4f-452b-ba2e-24576c96e81b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:12.669806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9004fed7-2b4f-452b-ba2e-24576c96e81b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:12.675171 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9004fed7-2b4f-452b-ba2e-24576c96e81b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:12.675171 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9004fed7-2b4f-452b-ba2e-24576c96e81b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:12.675171 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9004fed7-2b4f-452b-ba2e-24576c96e81b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:12.696267 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9004fed7-2b4f-452b-ba2e-24576c96e81b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/ips" status: 200 len: 149 microversion: 2.1 time: 0.040351 Jul 18 17:26:12.696876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1215/2014] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 17:26:12 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:26:14.288825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-561cf7cf-46cc-4ced-9bc9-2007cbb8eadd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd2cd329-e5f2-47d3-bacf-567352a75096"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:26:14.289879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-561cf7cf-46cc-4ced-9bc9-2007cbb8eadd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:14.296936 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-561cf7cf-46cc-4ced-9bc9-2007cbb8eadd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:14.297394 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-561cf7cf-46cc-4ced-9bc9-2007cbb8eadd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:14.298122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-561cf7cf-46cc-4ced-9bc9-2007cbb8eadd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:14.298553 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-561cf7cf-46cc-4ced-9bc9-2007cbb8eadd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:14.891837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-561cf7cf-46cc-4ced-9bc9-2007cbb8eadd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.607209 Jul 18 17:26:14.892441 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1216/2015] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 17:26:14 2022] POST /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments => generated 194 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:26:22.407532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-87bc21e6-432f-4c48-9fee-026f588b5c04 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: .version_select at 0x7fd6ae161430>, body: {"keypair": {"name": "tempest-keypair-316751055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD9l17fdmrN7yUduNtchU/zoJ/dcsPcltal2IphTJoMHTX+NE7Nbv2jign6ssjBe8hNKud6pfD4vvNXSa9WuNfTiqlJdt6LemCOv3IDpSBE+vjICI2EQzfTvSTMQuiaMA=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:26:22.421528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-87bc21e6-432f-4c48-9fee-026f588b5c04 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for project 60611329802847dd9da7d4d230ab32a4. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:26:22.425331 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-87bc21e6-432f-4c48-9fee-026f588b5c04 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for user a708e1f37fd5453198e32ec6427afcaa and project 60611329802847dd9da7d4d230ab32a4. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:26:22.483084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-87bc21e6-432f-4c48-9fee-026f588b5c04 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080203 Jul 18 17:26:22.483816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1217/2016] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 17:26:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:26:24.585991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1038873687", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d93bdb0-53cc-4bb1-8136-c043e0adfbdb"}], "security_groups": [{"name": "tempest-securitygroup--1258692761"}], "key_name": "tempest-keypair-316751055", "user_data": "}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:26:24.684256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] validate_networks() for [('7d93bdb0-53cc-4bb1-8136-c043e0adfbdb', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:26:24.838523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:26:25.098825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:26:25.099248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:26:25.099744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:26:25.100152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:26:25.100560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:26:25.109721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:25.110225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:25.111056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:25.111509 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:25.128130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for project 60611329802847dd9da7d4d230ab32a4. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:26:25.132642 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for user a708e1f37fd5453198e32ec6427afcaa and project 60611329802847dd9da7d4d230ab32a4. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:26:25.143900 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:26:25.146830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:26:25.261790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9886e329-f8ec-42dc-a8e7-36752eda38ba tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684628 Jul 18 17:26:25.262437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1218/2017] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:26:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:26:25.273604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4f742005-7471-4628-a7ac-8fbedbc95562 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:25.273604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4f742005-7471-4628-a7ac-8fbedbc95562 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:25.330284 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f742005-7471-4628-a7ac-8fbedbc95562 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:25.337254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4f742005-7471-4628-a7ac-8fbedbc95562 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1241 microversion: 2.1 time: 0.068163 Jul 18 17:26:25.338021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1219/2018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:25 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:26.354811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-085058a9-73b0-4b42-ace7-90981e92c823 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:26.355558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-085058a9-73b0-4b42-ace7-90981e92c823 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:26.362208 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-085058a9-73b0-4b42-ace7-90981e92c823 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:26.362654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-085058a9-73b0-4b42-ace7-90981e92c823 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:26.364165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-085058a9-73b0-4b42-ace7-90981e92c823 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:26.364613 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-085058a9-73b0-4b42-ace7-90981e92c823 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:26.428087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-085058a9-73b0-4b42-ace7-90981e92c823 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:26.436499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-085058a9-73b0-4b42-ace7-90981e92c823 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1245 microversion: 2.1 time: 0.085650 Jul 18 17:26:26.437054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1220/2019] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:26 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:27.455437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3f4c7518-8936-4eca-a3c3-96ae5888dc42 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:27.456448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3f4c7518-8936-4eca-a3c3-96ae5888dc42 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:27.463311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f4c7518-8936-4eca-a3c3-96ae5888dc42 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:27.463794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f4c7518-8936-4eca-a3c3-96ae5888dc42 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:27.464561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f4c7518-8936-4eca-a3c3-96ae5888dc42 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:27.465002 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f4c7518-8936-4eca-a3c3-96ae5888dc42 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:27.528661 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3f4c7518-8936-4eca-a3c3-96ae5888dc42 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:27.536771 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3f4c7518-8936-4eca-a3c3-96ae5888dc42 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1311 microversion: 2.1 time: 0.085600 Jul 18 17:26:27.537332 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1221/2020] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:27 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:28.555687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1e289f8a-4bb3-4746-acdc-fbd9a627d8c4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:28.557102 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1e289f8a-4bb3-4746-acdc-fbd9a627d8c4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:28.563273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e289f8a-4bb3-4746-acdc-fbd9a627d8c4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:28.563920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e289f8a-4bb3-4746-acdc-fbd9a627d8c4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:28.564943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e289f8a-4bb3-4746-acdc-fbd9a627d8c4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:28.565992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1e289f8a-4bb3-4746-acdc-fbd9a627d8c4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:28.763749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1e289f8a-4bb3-4746-acdc-fbd9a627d8c4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:28.771472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1e289f8a-4bb3-4746-acdc-fbd9a627d8c4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1367 microversion: 2.1 time: 0.221543 Jul 18 17:26:28.772064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1222/2021] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:28 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:29.214179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-17a4d8d1-dee7-460b-8bae-0a53b047258c req-cfa30405-89fa-472e-97cb-1155511823a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77", "tag": "1e116443-7490-4c58-8cfb-375b0984a8e3"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:26:29.222586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-17a4d8d1-dee7-460b-8bae-0a53b047258c req-cfa30405-89fa-472e-97cb-1155511823a5 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:29.223027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-17a4d8d1-dee7-460b-8bae-0a53b047258c req-cfa30405-89fa-472e-97cb-1155511823a5 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:29.235254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-17a4d8d1-dee7-460b-8bae-0a53b047258c req-cfa30405-89fa-472e-97cb-1155511823a5 service nova] Creating event network-changed:1e116443-7490-4c58-8cfb-375b0984a8e3 for instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 on hv-cinder-84617 Jul 18 17:26:29.241194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-17a4d8d1-dee7-460b-8bae-0a53b047258c req-cfa30405-89fa-472e-97cb-1155511823a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096967 Jul 18 17:26:29.242105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1223/2022] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:26:29.792337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bc150f62-9ebf-4e7a-bfd4-06e32fab5ba4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:29.793066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bc150f62-9ebf-4e7a-bfd4-06e32fab5ba4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:29.799260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc150f62-9ebf-4e7a-bfd4-06e32fab5ba4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:29.799745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc150f62-9ebf-4e7a-bfd4-06e32fab5ba4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:29.801938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc150f62-9ebf-4e7a-bfd4-06e32fab5ba4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:29.801938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc150f62-9ebf-4e7a-bfd4-06e32fab5ba4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:29.929722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bc150f62-9ebf-4e7a-bfd4-06e32fab5ba4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:29.936979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bc150f62-9ebf-4e7a-bfd4-06e32fab5ba4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1367 microversion: 2.1 time: 0.149283 Jul 18 17:26:29.937533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1224/2023] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:29 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:30.953875 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-97cac92f-02b2-4515-9a0a-6efda1d06a88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:30.954504 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-97cac92f-02b2-4515-9a0a-6efda1d06a88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:30.961713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97cac92f-02b2-4515-9a0a-6efda1d06a88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:30.962159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97cac92f-02b2-4515-9a0a-6efda1d06a88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:30.962937 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97cac92f-02b2-4515-9a0a-6efda1d06a88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:30.963359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-97cac92f-02b2-4515-9a0a-6efda1d06a88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:31.095456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-97cac92f-02b2-4515-9a0a-6efda1d06a88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:31.103049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-97cac92f-02b2-4515-9a0a-6efda1d06a88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1367 microversion: 2.1 time: 0.153139 Jul 18 17:26:31.103634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1225/2024] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:30 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:32.119105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-abf4599e-4536-45a4-80b1-2bdd70b8bf9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:32.119799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-abf4599e-4536-45a4-80b1-2bdd70b8bf9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:32.126535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abf4599e-4536-45a4-80b1-2bdd70b8bf9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:32.126979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abf4599e-4536-45a4-80b1-2bdd70b8bf9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:32.127763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abf4599e-4536-45a4-80b1-2bdd70b8bf9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:32.128201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-abf4599e-4536-45a4-80b1-2bdd70b8bf9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:32.257386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-abf4599e-4536-45a4-80b1-2bdd70b8bf9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:32.265287 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-abf4599e-4536-45a4-80b1-2bdd70b8bf9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1367 microversion: 2.1 time: 0.150021 Jul 18 17:26:32.265849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1226/2025] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:32 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:33.282064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8aa3ed74-2e9f-4c6b-8336-921883bc7f56 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:33.282705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8aa3ed74-2e9f-4c6b-8336-921883bc7f56 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:33.289476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8aa3ed74-2e9f-4c6b-8336-921883bc7f56 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:33.289924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8aa3ed74-2e9f-4c6b-8336-921883bc7f56 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:33.290679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8aa3ed74-2e9f-4c6b-8336-921883bc7f56 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:33.291134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8aa3ed74-2e9f-4c6b-8336-921883bc7f56 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:33.420555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8aa3ed74-2e9f-4c6b-8336-921883bc7f56 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:33.428703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8aa3ed74-2e9f-4c6b-8336-921883bc7f56 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1367 microversion: 2.1 time: 0.150378 Jul 18 17:26:33.429455 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1227/2026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:33 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:34.446241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9bd119ff-47ad-45d4-9080-9cd3c2c31be6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:34.446869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9bd119ff-47ad-45d4-9080-9cd3c2c31be6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:34.453254 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9bd119ff-47ad-45d4-9080-9cd3c2c31be6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:34.453706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9bd119ff-47ad-45d4-9080-9cd3c2c31be6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:34.454463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9bd119ff-47ad-45d4-9080-9cd3c2c31be6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:34.454902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9bd119ff-47ad-45d4-9080-9cd3c2c31be6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:34.585887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-9bd119ff-47ad-45d4-9080-9cd3c2c31be6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:34.593358 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9bd119ff-47ad-45d4-9080-9cd3c2c31be6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1367 microversion: 2.1 time: 0.150982 Jul 18 17:26:34.593920 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1228/2027] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:34 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:35.390586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:26:35.390586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=12 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:26:35.443366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-bdf9b1ec-5b09-4557-ba67-dc10dce747e3 req-59134b2d-6932-4d05-a477-03578d6667bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77", "name": "network-vif-plugged", "status": "completed", "tag": "1e116443-7490-4c58-8cfb-375b0984a8e3"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:26:35.451645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-bdf9b1ec-5b09-4557-ba67-dc10dce747e3 req-59134b2d-6932-4d05-a477-03578d6667bc service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:35.452205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-bdf9b1ec-5b09-4557-ba67-dc10dce747e3 req-59134b2d-6932-4d05-a477-03578d6667bc service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:35.463011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-bdf9b1ec-5b09-4557-ba67-dc10dce747e3 req-59134b2d-6932-4d05-a477-03578d6667bc service nova] Creating event network-vif-plugged:1e116443-7490-4c58-8cfb-375b0984a8e3 for instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 on hv-cinder-84617 Jul 18 17:26:35.467898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-bdf9b1ec-5b09-4557-ba67-dc10dce747e3 req-59134b2d-6932-4d05-a477-03578d6667bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084146 Jul 18 17:26:35.468465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1229/2028] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:26:35.610833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-36788494-c489-4b5e-baa3-e0af3b29afd9 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:35.611699 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-36788494-c489-4b5e-baa3-e0af3b29afd9 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:35.619622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36788494-c489-4b5e-baa3-e0af3b29afd9 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:35.620071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36788494-c489-4b5e-baa3-e0af3b29afd9 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:35.620837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36788494-c489-4b5e-baa3-e0af3b29afd9 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:35.621283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-36788494-c489-4b5e-baa3-e0af3b29afd9 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:35.755930 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-36788494-c489-4b5e-baa3-e0af3b29afd9 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:35.763502 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-36788494-c489-4b5e-baa3-e0af3b29afd9 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1367 microversion: 2.1 time: 0.156939 Jul 18 17:26:35.764101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1230/2029] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:35 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:36.781408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7d40c850-b333-4b29-826b-be57f9dc7efe tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:36.782153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7d40c850-b333-4b29-826b-be57f9dc7efe tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:36.788840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d40c850-b333-4b29-826b-be57f9dc7efe tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:36.789294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d40c850-b333-4b29-826b-be57f9dc7efe tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:36.790053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d40c850-b333-4b29-826b-be57f9dc7efe tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:36.790495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d40c850-b333-4b29-826b-be57f9dc7efe tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:36.920527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7d40c850-b333-4b29-826b-be57f9dc7efe tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:36.928634 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7d40c850-b333-4b29-826b-be57f9dc7efe tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1367 microversion: 2.1 time: 0.151290 Jul 18 17:26:36.929442 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1231/2030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:36 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:37.946300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3c94da0f-d16d-40b8-ba1f-8c69710fe697 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:37.946900 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3c94da0f-d16d-40b8-ba1f-8c69710fe697 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:37.953415 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c94da0f-d16d-40b8-ba1f-8c69710fe697 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:37.953976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c94da0f-d16d-40b8-ba1f-8c69710fe697 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:37.954766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c94da0f-d16d-40b8-ba1f-8c69710fe697 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:37.955228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3c94da0f-d16d-40b8-ba1f-8c69710fe697 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:38.088384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3c94da0f-d16d-40b8-ba1f-8c69710fe697 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:26:38.095777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3c94da0f-d16d-40b8-ba1f-8c69710fe697 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1557 microversion: 2.1 time: 0.153312 Jul 18 17:26:38.096341 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1232/2031] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:26:37 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:26:38.111511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ac5cf8bd-7afd-467b-b119-c17af4856497 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:26:38.112006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ac5cf8bd-7afd-467b-b119-c17af4856497 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:26:38.118435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac5cf8bd-7afd-467b-b119-c17af4856497 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:38.118877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac5cf8bd-7afd-467b-b119-c17af4856497 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:38.119655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac5cf8bd-7afd-467b-b119-c17af4856497 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:38.120093 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ac5cf8bd-7afd-467b-b119-c17af4856497 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:38.201411 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ac5cf8bd-7afd-467b-b119-c17af4856497 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093477 Jul 18 17:26:38.202065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1233/2032] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 18 17:26:38 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:26:39.422375 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-5ea755f1-36f7-432e-af36-8f96a6fd2674 req-2add1119-d243-4c9f-9e4d-c8821433f371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77", "tag": "1e116443-7490-4c58-8cfb-375b0984a8e3"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:26:39.430744 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5ea755f1-36f7-432e-af36-8f96a6fd2674 req-2add1119-d243-4c9f-9e4d-c8821433f371 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:26:39.431182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5ea755f1-36f7-432e-af36-8f96a6fd2674 req-2add1119-d243-4c9f-9e4d-c8821433f371 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:26:39.445105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-5ea755f1-36f7-432e-af36-8f96a6fd2674 req-2add1119-d243-4c9f-9e4d-c8821433f371 service nova] Creating event network-changed:1e116443-7490-4c58-8cfb-375b0984a8e3 for instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 on hv-cinder-84617 Jul 18 17:26:39.450106 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-5ea755f1-36f7-432e-af36-8f96a6fd2674 req-2add1119-d243-4c9f-9e4d-c8821433f371 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032069 Jul 18 17:26:39.450711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1234/2033] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:15.653545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a785cc30-1afa-425d-8778-79ee5cdc0e14 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:15.654243 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a785cc30-1afa-425d-8778-79ee5cdc0e14 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:15.656480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:27:15.657279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=78 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:27:15.662313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a785cc30-1afa-425d-8778-79ee5cdc0e14 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:15.662766 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a785cc30-1afa-425d-8778-79ee5cdc0e14 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:15.663562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a785cc30-1afa-425d-8778-79ee5cdc0e14 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:15.664009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a785cc30-1afa-425d-8778-79ee5cdc0e14 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:15.687040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a785cc30-1afa-425d-8778-79ee5cdc0e14 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77/ips" status: 200 len: 150 microversion: 2.1 time: 0.037655 Jul 18 17:27:15.687663 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1235/2034] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 17:27:15 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:15.698134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd2cd329-e5f2-47d3-bacf-567352a75096"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:15.699178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:15.705560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:15.706651 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:15.707539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:15.707992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:15.785223 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Invalid volume: volume cd2cd329-e5f2-47d3-bacf-567352a75096 is already attached to instances: 54591214-04e4-4bba-b394-917103e800af Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: POST /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77/os-volume_attachments HTTP/1.1 Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 74 Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:27:15.787003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {"volumeAttachment": {"volumeId": "cd2cd329-e5f2-47d3-bacf-567352a75096"}} Jul 18 17:27:15.788877 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Invalid volume: volume cd2cd329-e5f2-47d3-bacf-567352a75096 is already attached to instances: 54591214-04e4-4bba-b394-917103e800af Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'server_id': 'fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77', 'body': {'volumeAttachment': {'volumeId': 'cd2cd329-e5f2-47d3-bacf-567352a75096'}}} Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cd2cd329-e5f2-47d3-bacf-567352a75096 is already attached to instances: 54591214-04e4-4bba-b394-917103e800af Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:15.790164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cd2cd329-e5f2-47d3-bacf-567352a75096 is already attached to instances: 54591214-04e4-4bba-b394-917103e800af Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:15.792087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:15.793896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:15.793896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:27:15.793896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:27:15.793896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cd2cd329-e5f2-47d3-bacf-567352a75096 is already attached to instances: 54591214-04e4-4bba-b394-917103e800af Jul 18 17:27:15.793896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:15.793896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 400 to user: Invalid volume: volume cd2cd329-e5f2-47d3-bacf-567352a75096 is already attached to instances: 54591214-04e4-4bba-b394-917103e800af {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:27:15.793896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7d21709a-d153-4a73-8ca8-a7f37f2ba033 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093944 Jul 18 17:27:15.793896 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1236/2035] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 17:27:15 2022] POST /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:27:15.796657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d249ce41-fe9c-4ce5-9fb9-ee6c4510b5ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:15.797143 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d249ce41-fe9c-4ce5-9fb9-ee6c4510b5ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:15.803112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d249ce41-fe9c-4ce5-9fb9-ee6c4510b5ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:15.803599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d249ce41-fe9c-4ce5-9fb9-ee6c4510b5ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:15.804384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d249ce41-fe9c-4ce5-9fb9-ee6c4510b5ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:15.804824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d249ce41-fe9c-4ce5-9fb9-ee6c4510b5ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:15.833488 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d249ce41-fe9c-4ce5-9fb9-ee6c4510b5ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:27:16.007465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d249ce41-fe9c-4ce5-9fb9-ee6c4510b5ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 204 len: 0 microversion: 2.1 time: 0.213994 Jul 18 17:27:16.008096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1237/2036] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:27:15 2022] DELETE /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:27:16.016975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-61b15a2d-0458-47b2-ba4a-1b636c2e0c88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:16.017721 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-61b15a2d-0458-47b2-ba4a-1b636c2e0c88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:16.023757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61b15a2d-0458-47b2-ba4a-1b636c2e0c88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:16.025760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61b15a2d-0458-47b2-ba4a-1b636c2e0c88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:16.025760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61b15a2d-0458-47b2-ba4a-1b636c2e0c88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:16.025760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-61b15a2d-0458-47b2-ba4a-1b636c2e0c88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:16.163806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-61b15a2d-0458-47b2-ba4a-1b636c2e0c88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:16.172123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-61b15a2d-0458-47b2-ba4a-1b636c2e0c88 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1682 microversion: 2.1 time: 0.159529 Jul 18 17:27:16.172740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1238/2037] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:16 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:17.190175 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ed333976-7585-4f00-96cb-f8f102bfade1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:17.191273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ed333976-7585-4f00-96cb-f8f102bfade1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:17.197980 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed333976-7585-4f00-96cb-f8f102bfade1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:17.198429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed333976-7585-4f00-96cb-f8f102bfade1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:17.199303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed333976-7585-4f00-96cb-f8f102bfade1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:17.199807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ed333976-7585-4f00-96cb-f8f102bfade1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:17.327783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ed333976-7585-4f00-96cb-f8f102bfade1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:17.335846 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ed333976-7585-4f00-96cb-f8f102bfade1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1682 microversion: 2.1 time: 0.149557 Jul 18 17:27:17.336410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1239/2038] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:17 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:18.319289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-2cd26476-5568-4b3f-888c-4fa3bffcb309 req-4f57141d-13eb-4b2d-acad-b8aeb373e98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77", "name": "network-vif-deleted", "tag": "1e116443-7490-4c58-8cfb-375b0984a8e3"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:18.329107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-2cd26476-5568-4b3f-888c-4fa3bffcb309 req-4f57141d-13eb-4b2d-acad-b8aeb373e98c service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:18.329556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-2cd26476-5568-4b3f-888c-4fa3bffcb309 req-4f57141d-13eb-4b2d-acad-b8aeb373e98c service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:18.341380 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-2cd26476-5568-4b3f-888c-4fa3bffcb309 req-4f57141d-13eb-4b2d-acad-b8aeb373e98c service nova] Creating event network-vif-deleted:1e116443-7490-4c58-8cfb-375b0984a8e3 for instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 on hv-cinder-84617 Jul 18 17:27:18.346346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-2cd26476-5568-4b3f-888c-4fa3bffcb309 req-4f57141d-13eb-4b2d-acad-b8aeb373e98c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031450 Jul 18 17:27:18.348344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1240/2039] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:27:18.355245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-603db640-b9c5-4df7-b6de-5966c7df21e4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:18.356345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-603db640-b9c5-4df7-b6de-5966c7df21e4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:18.364366 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-603db640-b9c5-4df7-b6de-5966c7df21e4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:18.365120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-603db640-b9c5-4df7-b6de-5966c7df21e4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:18.365887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-603db640-b9c5-4df7-b6de-5966c7df21e4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:18.366492 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-603db640-b9c5-4df7-b6de-5966c7df21e4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:18.441890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-603db640-b9c5-4df7-b6de-5966c7df21e4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:18.450125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-603db640-b9c5-4df7-b6de-5966c7df21e4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 200 len: 1614 microversion: 2.1 time: 0.099514 Jul 18 17:27:18.450873 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1241/2040] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:18 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:19.468630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:19.469231 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:19.475975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:19.476421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:19.477190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:19.477621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:19.491192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 HTTP/1.1 Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:27:19.492897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:27:19.494624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77'} Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:27:19.495810 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:27:19.497446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:19.499020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:27:19.499020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6bee555f-cfd2-4b5a-811d-279e8f70ac0b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 404 len: 111 microversion: 2.1 time: 0.029534 Jul 18 17:27:19.499020 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1242/2041] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:19 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:27:19.502589 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-67140fe2-84a5-4c1f-8c7f-c06133da71f0 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '.version_select at 0x7fd6ae3ecd30>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:19.597483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-67140fe2-84a5-4c1f-8c7f-c06133da71f0 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316751055" status: 202 len: 0 microversion: 2.1 time: 0.098237 Jul 18 17:27:19.598078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1243/2042] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 18 17:27:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316751055 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:27:20.489687 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1195962d-4d02-4610-8038-259fb9edc30b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:20.490359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1195962d-4d02-4610-8038-259fb9edc30b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:20.497241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1195962d-4d02-4610-8038-259fb9edc30b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:20.497695 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1195962d-4d02-4610-8038-259fb9edc30b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:20.498457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1195962d-4d02-4610-8038-259fb9edc30b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:20.498901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1195962d-4d02-4610-8038-259fb9edc30b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:20.577938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-1195962d-4d02-4610-8038-259fb9edc30b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lazy-loading 'services' on Instance uuid 54591214-04e4-4bba-b394-917103e800af {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:27:20.794605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1195962d-4d02-4610-8038-259fb9edc30b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments/cd2cd329-e5f2-47d3-bacf-567352a75096" status: 202 len: 0 microversion: 2.1 time: 0.309348 Jul 18 17:27:20.795187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1244/2043] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 17:27:20 2022] DELETE /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments/cd2cd329-e5f2-47d3-bacf-567352a75096 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:27:20.803674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2eed5982-0742-4233-a00b-986e2f6b89bd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:20.804693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2eed5982-0742-4233-a00b-986e2f6b89bd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:20.811229 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2eed5982-0742-4233-a00b-986e2f6b89bd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:20.811712 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2eed5982-0742-4233-a00b-986e2f6b89bd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:20.812472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2eed5982-0742-4233-a00b-986e2f6b89bd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:20.812911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2eed5982-0742-4233-a00b-986e2f6b89bd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:20.843859 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2eed5982-0742-4233-a00b-986e2f6b89bd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Jul 18 17:27:20.844425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1245/2044] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:27:20 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:21.855622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0357b6d6-3664-48f2-9756-1111343865d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:21.856540 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0357b6d6-3664-48f2-9756-1111343865d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:21.863823 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0357b6d6-3664-48f2-9756-1111343865d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:21.864233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0357b6d6-3664-48f2-9756-1111343865d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:21.864990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0357b6d6-3664-48f2-9756-1111343865d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:21.865440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0357b6d6-3664-48f2-9756-1111343865d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:21.899049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0357b6d6-3664-48f2-9756-1111343865d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047370 Jul 18 17:27:21.899649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1246/2045] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:27:21 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:22.910932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-307d8753-9741-4612-9b0f-0d9c4756b7dc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:22.911914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-307d8753-9741-4612-9b0f-0d9c4756b7dc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:22.918470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-307d8753-9741-4612-9b0f-0d9c4756b7dc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:22.918923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-307d8753-9741-4612-9b0f-0d9c4756b7dc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:22.919716 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-307d8753-9741-4612-9b0f-0d9c4756b7dc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:22.920161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-307d8753-9741-4612-9b0f-0d9c4756b7dc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:22.949552 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-307d8753-9741-4612-9b0f-0d9c4756b7dc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042688 Jul 18 17:27:22.950101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1247/2046] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:27:22 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 17:27:23.007633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b4d220d0-2917-4e34-8fa3-00091da87ff4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:23.008130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b4d220d0-2917-4e34-8fa3-00091da87ff4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:23.014156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4d220d0-2917-4e34-8fa3-00091da87ff4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:23.014619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4d220d0-2917-4e34-8fa3-00091da87ff4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:23.015381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4d220d0-2917-4e34-8fa3-00091da87ff4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:23.015840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b4d220d0-2917-4e34-8fa3-00091da87ff4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:23.041092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b4d220d0-2917-4e34-8fa3-00091da87ff4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:27:23.326420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b4d220d0-2917-4e34-8fa3-00091da87ff4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 204 len: 0 microversion: 2.1 time: 0.322278 Jul 18 17:27:23.327012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1248/2047] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:27:23 2022] DELETE /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:27:23.335152 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e12e2db4-5056-4157-97fd-d80f4c9ae836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:23.335885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e12e2db4-5056-4157-97fd-d80f4c9ae836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:23.341860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e12e2db4-5056-4157-97fd-d80f4c9ae836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:23.342311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e12e2db4-5056-4157-97fd-d80f4c9ae836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:23.343072 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e12e2db4-5056-4157-97fd-d80f4c9ae836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:23.343540 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e12e2db4-5056-4157-97fd-d80f4c9ae836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:23.475725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e12e2db4-5056-4157-97fd-d80f4c9ae836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:23.483522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e12e2db4-5056-4157-97fd-d80f4c9ae836 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1679 microversion: 2.1 time: 0.152159 Jul 18 17:27:23.484013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1249/2048] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:23 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:24.499850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-02f68ab9-04c3-4e49-9d27-d654e0aa5d65 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:24.500556 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-02f68ab9-04c3-4e49-9d27-d654e0aa5d65 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:24.507221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02f68ab9-04c3-4e49-9d27-d654e0aa5d65 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:24.507708 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02f68ab9-04c3-4e49-9d27-d654e0aa5d65 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:24.508472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02f68ab9-04c3-4e49-9d27-d654e0aa5d65 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:24.508912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-02f68ab9-04c3-4e49-9d27-d654e0aa5d65 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:24.512986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:27:24.646262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-02f68ab9-04c3-4e49-9d27-d654e0aa5d65 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:24.653787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-02f68ab9-04c3-4e49-9d27-d654e0aa5d65 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1679 microversion: 2.1 time: 0.157816 Jul 18 17:27:24.654346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1250/2049] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:24 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:25.662037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-d8059702-03e3-4737-bf43-0f99b1ebf4cc req-296f80ca-6ce7-4c55-a85c-481bd3637824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54591214-04e4-4bba-b394-917103e800af", "name": "network-vif-deleted", "tag": "968e4710-f261-41c5-8fff-1d5a8e1fa9e7"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:25.673417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d8059702-03e3-4737-bf43-0f99b1ebf4cc req-296f80ca-6ce7-4c55-a85c-481bd3637824 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:25.673417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d8059702-03e3-4737-bf43-0f99b1ebf4cc req-296f80ca-6ce7-4c55-a85c-481bd3637824 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:25.685042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-d8059702-03e3-4737-bf43-0f99b1ebf4cc req-296f80ca-6ce7-4c55-a85c-481bd3637824 service nova] Creating event network-vif-deleted:968e4710-f261-41c5-8fff-1d5a8e1fa9e7 for instance 54591214-04e4-4bba-b394-917103e800af on hv-cinder-84617 Jul 18 17:27:25.690288 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-d8059702-03e3-4737-bf43-0f99b1ebf4cc req-296f80ca-6ce7-4c55-a85c-481bd3637824 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032170 Jul 18 17:27:25.692493 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1251/2050] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:25.696445 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-65cb97f6-20f8-49f7-a170-606db19a15a6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:25.697233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-65cb97f6-20f8-49f7-a170-606db19a15a6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:25.705538 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65cb97f6-20f8-49f7-a170-606db19a15a6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:25.707082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65cb97f6-20f8-49f7-a170-606db19a15a6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:25.711849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65cb97f6-20f8-49f7-a170-606db19a15a6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:25.716282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-65cb97f6-20f8-49f7-a170-606db19a15a6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:25.788608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-65cb97f6-20f8-49f7-a170-606db19a15a6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:25.797298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-65cb97f6-20f8-49f7-a170-606db19a15a6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 200 len: 1612 microversion: 2.1 time: 0.104760 Jul 18 17:27:25.797884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1252/2051] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:25 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 1612 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:26.503693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-37ea2c7e-a926-4c45-b17a-a730cce26b5b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:26.504091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37ea2c7e-a926-4c45-b17a-a730cce26b5b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:26.511641 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ea2c7e-a926-4c45-b17a-a730cce26b5b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:26.512087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ea2c7e-a926-4c45-b17a-a730cce26b5b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:26.514568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ea2c7e-a926-4c45-b17a-a730cce26b5b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:26.514568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ea2c7e-a926-4c45-b17a-a730cce26b5b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:26.539961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37ea2c7e-a926-4c45-b17a-a730cce26b5b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:27:26.779232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-37ea2c7e-a926-4c45-b17a-a730cce26b5b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 204 len: 0 microversion: 2.1 time: 0.279698 Jul 18 17:27:26.779941 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1253/2052] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:27:26 2022] DELETE /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 17:27:26.788454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a01ac2e5-5994-43f7-81ae-2584a3024047 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:26.789066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a01ac2e5-5994-43f7-81ae-2584a3024047 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:26.795096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a01ac2e5-5994-43f7-81ae-2584a3024047 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:26.795591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a01ac2e5-5994-43f7-81ae-2584a3024047 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:26.796401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a01ac2e5-5994-43f7-81ae-2584a3024047 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:26.796839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a01ac2e5-5994-43f7-81ae-2584a3024047 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:26.928279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a01ac2e5-5994-43f7-81ae-2584a3024047 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:26.936650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a01ac2e5-5994-43f7-81ae-2584a3024047 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1577 microversion: 2.1 time: 0.152451 Jul 18 17:27:26.937469 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1254/2053] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:26 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:26.942163 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:26.942756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:26.948476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:26.948916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:26.949654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:26.950083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:26.963736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af HTTP/1.1 Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:27:26.965386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:27:26.967338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '54591214-04e4-4bba-b394-917103e800af'} Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:27:26.968406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:27:26.970234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:26.972499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:27:26.972499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7f26cd9b-dbe8-4043-a037-49e21b83ba37 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 404 len: 111 microversion: 2.1 time: 0.028271 Jul 18 17:27:26.972499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1255/2054] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:26 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:27:26.975682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-353d3a7a-8812-47dc-b20b-926814d67e98 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '.version_select at 0x7fd6ae0a5670>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:27.025749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-353d3a7a-8812-47dc-b20b-926814d67e98 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989056327" status: 202 len: 0 microversion: 2.1 time: 0.054027 Jul 18 17:27:27.026322 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1256/2055] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jul 18 17:27:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989056327 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:27:27.954572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-071c93f6-4989-48a2-9ffc-1e1ea3308be8 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:27.956127 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-071c93f6-4989-48a2-9ffc-1e1ea3308be8 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:27.964277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-071c93f6-4989-48a2-9ffc-1e1ea3308be8 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:27.964725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-071c93f6-4989-48a2-9ffc-1e1ea3308be8 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:27.965505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-071c93f6-4989-48a2-9ffc-1e1ea3308be8 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:27.965951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-071c93f6-4989-48a2-9ffc-1e1ea3308be8 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:28.117180 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-071c93f6-4989-48a2-9ffc-1e1ea3308be8 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:28.124670 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-071c93f6-4989-48a2-9ffc-1e1ea3308be8 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1577 microversion: 2.1 time: 0.174036 Jul 18 17:27:28.125223 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1257/2056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:27 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:28.130533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-36c13548-ccc5-4763-87f9-20259651c776 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: .version_select at 0x7fd6ae0a50d0>, body: {"keypair": {"name": "tempest-keypair-1327466298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/ZgB3UXAGZyxV7m/h/ut6nK6vT2NbdbRFUfIxvDfnmuhOr0yXOQgaPqWvEdYQGoJQY1VM84jBtKM8urgbGGXMabCYmnKMn/YuHzUm6fNjHKkYSwaEnGjnsnAgfJm6h2g=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:28.144168 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-36c13548-ccc5-4763-87f9-20259651c776 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for project 60611329802847dd9da7d4d230ab32a4. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:27:28.148000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-36c13548-ccc5-4763-87f9-20259651c776 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for user a708e1f37fd5453198e32ec6427afcaa and project 60611329802847dd9da7d4d230ab32a4. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:27:28.243280 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-36c13548-ccc5-4763-87f9-20259651c776 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116968 Jul 18 17:27:28.244033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1258/2057] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 17:27:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:27:29.143068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f78ad215-445a-47b4-8601-278dc5d91f5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:29.144539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f78ad215-445a-47b4-8601-278dc5d91f5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:29.150840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f78ad215-445a-47b4-8601-278dc5d91f5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:29.151290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f78ad215-445a-47b4-8601-278dc5d91f5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:29.152077 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f78ad215-445a-47b4-8601-278dc5d91f5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:29.152508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f78ad215-445a-47b4-8601-278dc5d91f5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:29.226527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f78ad215-445a-47b4-8601-278dc5d91f5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:29.234408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f78ad215-445a-47b4-8601-278dc5d91f5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1510 microversion: 2.1 time: 0.096089 Jul 18 17:27:29.240414 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1259/2058] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:29 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1510 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:29.389782 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-6a681175-448f-4a8c-b732-07599c523950 req-d5f4c8cf-d9b2-4091-9174-87848d97e58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db020acd-c5ee-48df-9832-c5a270c4e9b4", "name": "network-vif-deleted", "tag": "ad2677ec-4fff-4983-a4e7-ce060544d5e9"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:29.400863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-6a681175-448f-4a8c-b732-07599c523950 req-d5f4c8cf-d9b2-4091-9174-87848d97e58f service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:29.401308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-6a681175-448f-4a8c-b732-07599c523950 req-d5f4c8cf-d9b2-4091-9174-87848d97e58f service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:29.419144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-6a681175-448f-4a8c-b732-07599c523950 req-d5f4c8cf-d9b2-4091-9174-87848d97e58f service nova] Creating event network-vif-deleted:ad2677ec-4fff-4983-a4e7-ce060544d5e9 for instance db020acd-c5ee-48df-9832-c5a270c4e9b4 on hv-cinder-84617 Jul 18 17:27:29.428603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-6a681175-448f-4a8c-b732-07599c523950 req-d5f4c8cf-d9b2-4091-9174-87848d97e58f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043386 Jul 18 17:27:29.429217 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1260/2059] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:30.254398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:30.255091 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:30.261854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:30.262306 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:30.263673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:30.263945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:30.299339 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:30.300378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:30.300807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lazy-loading 'fault' on Instance uuid db020acd-c5ee-48df-9832-c5a270c4e9b4 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:27:30.348820 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:30.356704 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a1d02218-8180-4a2a-b0ae-0f6eecb6a0ea tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 200 len: 1231 microversion: 2.1 time: 0.108235 Jul 18 17:27:30.357768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1261/2060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:30 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:30.757130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-764561669", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d93bdb0-53cc-4bb1-8136-c043e0adfbdb"}], "security_groups": [{"name": "tempest-securitygroup--867604371"}], "key_name": "tempest-keypair-1327466298", "user_data": "}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:30.860512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] validate_networks() for [('7d93bdb0-53cc-4bb1-8136-c043e0adfbdb', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:27:31.227116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:27:31.227574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:27:31.228055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:27:31.228496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:27:31.228976 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:27:31.238840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:31.239294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:31.240255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:31.240726 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:31.259252 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for project 60611329802847dd9da7d4d230ab32a4. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:27:31.263282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for user a708e1f37fd5453198e32ec6427afcaa and project 60611329802847dd9da7d4d230ab32a4. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:27:31.265680 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:27:31.274861 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:27:31.278075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:27:31.403919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4e41d1ec-728d-47dd-9163-f3d039dda66c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.651641 Jul 18 17:27:31.404561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1262/2061] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:27:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 17:27:31.409623 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:31.410146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:31.416014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:31.416536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:31.417270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:31.417697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:31.434625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] HTTP exception thrown: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Request method failure captured: Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 HTTP/1.1 Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y5NIxgZ_lJYfP0hamSN64A2Aqmk5nS3TSNqBtu_JKjNm_XqQ3aM9Y2Xj-TfTyWMQM0du5VGvEn8eir7gfe8SE14ewvNUrdgsqmn2xDM46Ht3VyGT8DtYGxUAjhg9TTZaRCVYyuWjm_Wdpdc-mNGrBwr-dJN_RZLr1HubPdHemm9YQ8 Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:27:31.436326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e65f14a4bef42df904a5f15befe2e16", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}] Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: c243a50903b244519ccd58f02cb798da Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.438193 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '7dee0085-26fb-4535-8630-6f96f19445f5'} Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:27:31.439162 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.441063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.442946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Returning 404 to user: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:27:31.442946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6ff96e00-7541-4edd-919f-a6779ee57be7 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 404 len: 111 microversion: 2.1 time: 0.032166 Jul 18 17:27:31.442946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1263/2062] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:27:31 2022] DELETE /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:27:31.442946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:31.443561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:31.449466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:31.449916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:31.450675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:31.451134 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:31.464790 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] HTTP exception thrown: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Request method failure captured: Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 HTTP/1.1 Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zdcd81Ms_2Sj_wuc4Sc7z_tdUbQyX5KJYR0oRlgk3QpGUGqdOGUzUfxyJ4oWzxIYh3GjVKDGgy1RgQU1YDlyofJYwUqOkHmotVGNbl1viDBDXtq9zF8LsDVU58T_Zyab00k5G4YNzsTRO5hlVLrswhMfUH4DQor3f8GHt-lgiahdIA Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:27:31.466233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e4afeb76581942e4a0d72e4568907201", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}] Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: e1fc02859caf4ac09a85a4e5f962c14b Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:27:31.468115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'db020acd-c5ee-48df-9832-c5a270c4e9b4'} Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:27:31.469212 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:27:31.470918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.473151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Returning 404 to user: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:27:31.473151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d05e1a04-20c5-48df-babd-bd2d38575e75 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 404 len: 111 microversion: 2.1 time: 0.028528 Jul 18 17:27:31.473151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1264/2063] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:31 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:27:31.473447 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-42d84cb5-1100-4453-8b64-e8429d700bdb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:31.473996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-42d84cb5-1100-4453-8b64-e8429d700bdb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:31.534991 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-42d84cb5-1100-4453-8b64-e8429d700bdb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:31.541989 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-42d84cb5-1100-4453-8b64-e8429d700bdb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1241 microversion: 2.1 time: 0.072488 Jul 18 17:27:31.542559 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1265/2064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:31 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:31.547183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:31.547808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] [instance: 7dee0085-26fb-4535-8630-6f96f19445f5] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:31.557855 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:31.559619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:31.560404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:31.560849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:31.577480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] HTTP exception thrown: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Request method failure captured: Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 HTTP/1.1 Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Y5NIxgZ_lJYfP0hamSN64A2Aqmk5nS3TSNqBtu_JKjNm_XqQ3aM9Y2Xj-TfTyWMQM0du5VGvEn8eir7gfe8SE14ewvNUrdgsqmn2xDM46Ht3VyGT8DtYGxUAjhg9TTZaRCVYyuWjm_Wdpdc-mNGrBwr-dJN_RZLr1HubPdHemm9YQ8 Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:27:31.579053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9e65f14a4bef42df904a5f15befe2e16", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9e65f14a4bef42df904a5f15befe2e16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9e65f14a4bef42df904a5f15befe2e16"}]}] Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 9e65f14a4bef42df904a5f15befe2e16 Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeTestJSON-360440929 Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: c243a50903b244519ccd58f02cb798da Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeTestJSON-360440929-project Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.580592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '7dee0085-26fb-4535-8630-6f96f19445f5'} Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:27:31.581693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. Jul 18 17:27:31.583374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:27:31.584943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] Returning 404 to user: Instance 7dee0085-26fb-4535-8630-6f96f19445f5 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:27:31.584943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a8ca7aea-c68d-41f3-87d7-08c8050f63f4 tempest-AttachVolumeTestJSON-360440929 tempest-AttachVolumeTestJSON-360440929-project] 10.222.0.26 "GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5" status: 404 len: 111 microversion: 2.1 time: 0.036892 Jul 18 17:27:31.584943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1266/2065] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:31 2022] GET /compute/v2.1/servers/7dee0085-26fb-4535-8630-6f96f19445f5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:27:31.598098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1930709170", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2096064368", "security_groups": [{"name": "tempest-secgroup-smoke-285184171"}], "block_device_mapping_v2": [{"uuid": "01205a0e-3d4b-43b9-a2dd-89940e12dd7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba382ac1-9c33-468c-acb2-a793dc60447f"}]}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:31.720678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] validate_networks() for [('ba382ac1-9c33-468c-acb2-a793dc60447f', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:27:32.123179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:27:32.123679 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:27:32.124376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:27:32.124788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:27:32.125236 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:27:32.134245 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:32.134703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:32.135517 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:32.135968 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:32.153125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Getting quotas for project e4afeb76581942e4a0d72e4568907201. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:27:32.156988 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Getting quotas for user e1fc02859caf4ac09a85a4e5f962c14b and project e4afeb76581942e4a0d72e4568907201. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:27:32.217034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:27:32.219032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01205a0e-3d4b-43b9-a2dd-89940e12dd7f',volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:27:32.644120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-add1d00a-729d-4c19-9da9-2b46d8090658 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.049966 Jul 18 17:27:32.647144 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1267/2066] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:27:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 17:27:32.655227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5cc95c62-fa52-4d9d-9b09-88db89096321 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:32.656138 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5cc95c62-fa52-4d9d-9b09-88db89096321 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:32.664629 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5cc95c62-fa52-4d9d-9b09-88db89096321 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:32.665371 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5cc95c62-fa52-4d9d-9b09-88db89096321 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:32.666314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5cc95c62-fa52-4d9d-9b09-88db89096321 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:32.666919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5cc95c62-fa52-4d9d-9b09-88db89096321 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:32.764585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5cc95c62-fa52-4d9d-9b09-88db89096321 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:32.778808 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5cc95c62-fa52-4d9d-9b09-88db89096321 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1237 microversion: 2.1 time: 0.128162 Jul 18 17:27:32.787571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1268/2067] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:32 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:32.787571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cb8a4c5f-1561-4ade-80fe-e0c035e099da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:32.788227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cb8a4c5f-1561-4ade-80fe-e0c035e099da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:32.862019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cb8a4c5f-1561-4ade-80fe-e0c035e099da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:32.869495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cb8a4c5f-1561-4ade-80fe-e0c035e099da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1095 microversion: 2.1 time: 0.087559 Jul 18 17:27:32.870453 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1269/2068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:32 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:33.797498 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6a5267a9-3bf2-46c1-a9bd-47e7d0188bed tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:33.798854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6a5267a9-3bf2-46c1-a9bd-47e7d0188bed tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:33.807842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a5267a9-3bf2-46c1-a9bd-47e7d0188bed tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:33.808749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a5267a9-3bf2-46c1-a9bd-47e7d0188bed tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:33.809825 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a5267a9-3bf2-46c1-a9bd-47e7d0188bed tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:33.810572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6a5267a9-3bf2-46c1-a9bd-47e7d0188bed tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:33.907386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6a5267a9-3bf2-46c1-a9bd-47e7d0188bed tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:33.918079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6a5267a9-3bf2-46c1-a9bd-47e7d0188bed tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1299 microversion: 2.1 time: 0.125176 Jul 18 17:27:33.918658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1270/2069] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:33 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:33.927295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5bfcda3c-fdfc-41d3-867f-74c21c3eecc7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:33.927939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5bfcda3c-fdfc-41d3-867f-74c21c3eecc7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:33.938036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bfcda3c-fdfc-41d3-867f-74c21c3eecc7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:33.938491 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bfcda3c-fdfc-41d3-867f-74c21c3eecc7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:33.939460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bfcda3c-fdfc-41d3-867f-74c21c3eecc7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:33.940818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5bfcda3c-fdfc-41d3-867f-74c21c3eecc7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:34.060326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5bfcda3c-fdfc-41d3-867f-74c21c3eecc7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:34.069525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5bfcda3c-fdfc-41d3-867f-74c21c3eecc7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1137 microversion: 2.1 time: 0.149791 Jul 18 17:27:34.070178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1271/2070] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:33 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1137 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:34.399850 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:27:34.400461 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:27:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:27:34.936801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ca4ab9e8-edd1-46ec-af8a-d8579306b5bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:34.937256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ca4ab9e8-edd1-46ec-af8a-d8579306b5bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:34.946696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca4ab9e8-edd1-46ec-af8a-d8579306b5bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:34.953352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca4ab9e8-edd1-46ec-af8a-d8579306b5bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:34.953352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca4ab9e8-edd1-46ec-af8a-d8579306b5bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:34.953352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca4ab9e8-edd1-46ec-af8a-d8579306b5bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:35.316789 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ca4ab9e8-edd1-46ec-af8a-d8579306b5bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:35.327986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ca4ab9e8-edd1-46ec-af8a-d8579306b5bc tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1366 microversion: 2.1 time: 0.395387 Jul 18 17:27:35.336761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1272/2071] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:34 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:35.342770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-080af762-74a7-400a-ba09-b8b0a4fc273e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:35.343948 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-080af762-74a7-400a-ba09-b8b0a4fc273e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:35.350527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-080af762-74a7-400a-ba09-b8b0a4fc273e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:35.351259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-080af762-74a7-400a-ba09-b8b0a4fc273e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:35.352493 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-080af762-74a7-400a-ba09-b8b0a4fc273e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:35.353130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-080af762-74a7-400a-ba09-b8b0a4fc273e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:35.453733 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-080af762-74a7-400a-ba09-b8b0a4fc273e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:35.463389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-080af762-74a7-400a-ba09-b8b0a4fc273e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1211 microversion: 2.1 time: 0.125444 Jul 18 17:27:35.464514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1273/2072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:35 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1211 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:35.726011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-e6612d28-5744-493a-97a2-f9dd9bc4df5d req-cd740191-ce43-41d3-8c9b-640e668d942f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f746d48-e85c-4d24-9358-7f6be3b7ab25", "tag": "4856c290-15ed-4c21-9b2b-90c006d26dff"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:35.739427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-e6612d28-5744-493a-97a2-f9dd9bc4df5d req-cd740191-ce43-41d3-8c9b-640e668d942f service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:35.742953 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-e6612d28-5744-493a-97a2-f9dd9bc4df5d req-cd740191-ce43-41d3-8c9b-640e668d942f service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:35.751423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:27:35.772886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-e6612d28-5744-493a-97a2-f9dd9bc4df5d req-cd740191-ce43-41d3-8c9b-640e668d942f service nova] Creating event network-changed:4856c290-15ed-4c21-9b2b-90c006d26dff for instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 on hv-cinder-84617 Jul 18 17:27:35.780432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-e6612d28-5744-493a-97a2-f9dd9bc4df5d req-cd740191-ce43-41d3-8c9b-640e668d942f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059378 Jul 18 17:27:35.781612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1274/2073] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:36.350683 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c638e8fe-2e29-49f4-80ab-9d937dba7a15 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:36.351388 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c638e8fe-2e29-49f4-80ab-9d937dba7a15 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:36.358472 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c638e8fe-2e29-49f4-80ab-9d937dba7a15 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:36.358922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c638e8fe-2e29-49f4-80ab-9d937dba7a15 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:36.359717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c638e8fe-2e29-49f4-80ab-9d937dba7a15 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:36.360197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c638e8fe-2e29-49f4-80ab-9d937dba7a15 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:36.629487 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c638e8fe-2e29-49f4-80ab-9d937dba7a15 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:36.638083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c638e8fe-2e29-49f4-80ab-9d937dba7a15 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1366 microversion: 2.1 time: 0.294368 Jul 18 17:27:36.638672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1275/2074] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:36 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:36.652435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f87bd530-c10b-466b-a6e6-ae0b41c66a52 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:36.654792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f87bd530-c10b-466b-a6e6-ae0b41c66a52 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:36.668799 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f87bd530-c10b-466b-a6e6-ae0b41c66a52 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:36.669282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f87bd530-c10b-466b-a6e6-ae0b41c66a52 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:36.671949 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f87bd530-c10b-466b-a6e6-ae0b41c66a52 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:36.672404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f87bd530-c10b-466b-a6e6-ae0b41c66a52 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:37.202922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f87bd530-c10b-466b-a6e6-ae0b41c66a52 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:37.213757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f87bd530-c10b-466b-a6e6-ae0b41c66a52 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.568096 Jul 18 17:27:37.213757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1276/2075] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:36 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:37.342879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-d5fbe7eb-9e03-415f-a570-6a0f02589938 req-034eed4f-1af1-4eaa-bef9-864659c7f61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7247324-03e7-45a5-b149-28069aa739cf", "tag": "dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:37.351906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d5fbe7eb-9e03-415f-a570-6a0f02589938 req-034eed4f-1af1-4eaa-bef9-864659c7f61b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:37.357082 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-d5fbe7eb-9e03-415f-a570-6a0f02589938 req-034eed4f-1af1-4eaa-bef9-864659c7f61b service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:37.364131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-d5fbe7eb-9e03-415f-a570-6a0f02589938 req-034eed4f-1af1-4eaa-bef9-864659c7f61b service nova] Creating event network-changed:dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a for instance a7247324-03e7-45a5-b149-28069aa739cf on hv-cinder-84617 Jul 18 17:27:37.368897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-d5fbe7eb-9e03-415f-a570-6a0f02589938 req-034eed4f-1af1-4eaa-bef9-864659c7f61b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155636 Jul 18 17:27:37.369520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1277/2076] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:27:37.656450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-03fce900-5d0c-4dfe-a65e-818e6be871b3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:37.657071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-03fce900-5d0c-4dfe-a65e-818e6be871b3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:37.663851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03fce900-5d0c-4dfe-a65e-818e6be871b3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:37.664307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03fce900-5d0c-4dfe-a65e-818e6be871b3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:37.665073 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03fce900-5d0c-4dfe-a65e-818e6be871b3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:37.665515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-03fce900-5d0c-4dfe-a65e-818e6be871b3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:37.798637 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-03fce900-5d0c-4dfe-a65e-818e6be871b3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:37.807633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-03fce900-5d0c-4dfe-a65e-818e6be871b3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1366 microversion: 2.1 time: 0.155653 Jul 18 17:27:37.808286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1278/2077] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:37 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:38.229000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e38bcbf7-2df9-49db-83b6-38e13a3a4a66 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:38.229768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e38bcbf7-2df9-49db-83b6-38e13a3a4a66 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:38.235783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e38bcbf7-2df9-49db-83b6-38e13a3a4a66 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:38.237881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e38bcbf7-2df9-49db-83b6-38e13a3a4a66 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:38.237881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e38bcbf7-2df9-49db-83b6-38e13a3a4a66 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:38.238130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e38bcbf7-2df9-49db-83b6-38e13a3a4a66 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:38.382895 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e38bcbf7-2df9-49db-83b6-38e13a3a4a66 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:38.390512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e38bcbf7-2df9-49db-83b6-38e13a3a4a66 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.165608 Jul 18 17:27:38.391081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1279/2078] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:38 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:38.825410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6f8d4b91-2f3a-4ffa-a90c-f62da5ed51f4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:38.826013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6f8d4b91-2f3a-4ffa-a90c-f62da5ed51f4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:38.833037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f8d4b91-2f3a-4ffa-a90c-f62da5ed51f4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:38.833483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f8d4b91-2f3a-4ffa-a90c-f62da5ed51f4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:38.834247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f8d4b91-2f3a-4ffa-a90c-f62da5ed51f4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:38.834757 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f8d4b91-2f3a-4ffa-a90c-f62da5ed51f4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:38.963392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6f8d4b91-2f3a-4ffa-a90c-f62da5ed51f4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:38.970765 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6f8d4b91-2f3a-4ffa-a90c-f62da5ed51f4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1366 microversion: 2.1 time: 0.149183 Jul 18 17:27:38.971328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1280/2079] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:38 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:39.407590 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0e2d51aa-32dd-4871-ab1c-9f00a1cf12cf tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:39.408192 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0e2d51aa-32dd-4871-ab1c-9f00a1cf12cf tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:39.414713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e2d51aa-32dd-4871-ab1c-9f00a1cf12cf tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:39.415166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e2d51aa-32dd-4871-ab1c-9f00a1cf12cf tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:39.415966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e2d51aa-32dd-4871-ab1c-9f00a1cf12cf tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:39.416408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e2d51aa-32dd-4871-ab1c-9f00a1cf12cf tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:39.551416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0e2d51aa-32dd-4871-ab1c-9f00a1cf12cf tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:39.559332 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0e2d51aa-32dd-4871-ab1c-9f00a1cf12cf tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.155665 Jul 18 17:27:39.560422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1281/2080] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:39 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:39.988437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c4339f11-fd6e-45e4-9f2d-499259bb9eb2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:39.988960 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c4339f11-fd6e-45e4-9f2d-499259bb9eb2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:39.994883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4339f11-fd6e-45e4-9f2d-499259bb9eb2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:39.999021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4339f11-fd6e-45e4-9f2d-499259bb9eb2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:39.999021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4339f11-fd6e-45e4-9f2d-499259bb9eb2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:39.999021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4339f11-fd6e-45e4-9f2d-499259bb9eb2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:40.135258 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c4339f11-fd6e-45e4-9f2d-499259bb9eb2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:40.143604 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c4339f11-fd6e-45e4-9f2d-499259bb9eb2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1366 microversion: 2.1 time: 0.159114 Jul 18 17:27:40.147904 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1282/2081] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:39 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:40.382216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-fc5ff504-08e2-45fc-ac07-72806dd8fe4e tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6ae301280>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:40.431422 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-fc5ff504-08e2-45fc-ac07-72806dd8fe4e tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b2dbb0a9-bd03-47fc-bea5-3058649bd127" status: 200 len: 351 microversion: 2.1 time: 0.052971 Jul 18 17:27:40.432084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1283/2082] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 17:27:40 2022] GET /compute/v2.1/os-volumes/b2dbb0a9-bd03-47fc-bea5-3058649bd127 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:27:40.577156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6b9ef886-3c12-4ffe-876c-db3280a719ec tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:40.577767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6b9ef886-3c12-4ffe-876c-db3280a719ec tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:40.584235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b9ef886-3c12-4ffe-876c-db3280a719ec tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:40.584630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b9ef886-3c12-4ffe-876c-db3280a719ec tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:40.585390 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b9ef886-3c12-4ffe-876c-db3280a719ec tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:40.585837 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6b9ef886-3c12-4ffe-876c-db3280a719ec tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:40.717360 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6b9ef886-3c12-4ffe-876c-db3280a719ec tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:40.725179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6b9ef886-3c12-4ffe-876c-db3280a719ec tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.151981 Jul 18 17:27:40.725753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1284/2083] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:40 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:41.161118 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6f926c93-7654-4d26-bc8c-ae717ad35858 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:41.161753 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6f926c93-7654-4d26-bc8c-ae717ad35858 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:41.167811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f926c93-7654-4d26-bc8c-ae717ad35858 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:41.168262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f926c93-7654-4d26-bc8c-ae717ad35858 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:41.169019 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f926c93-7654-4d26-bc8c-ae717ad35858 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:41.169461 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6f926c93-7654-4d26-bc8c-ae717ad35858 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:41.301633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6f926c93-7654-4d26-bc8c-ae717ad35858 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:41.309316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6f926c93-7654-4d26-bc8c-ae717ad35858 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1366 microversion: 2.1 time: 0.152761 Jul 18 17:27:41.309868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1285/2084] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:41 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:41.742209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a08a83f5-f76a-46df-b045-912fface69da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:41.742883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a08a83f5-f76a-46df-b045-912fface69da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:41.750291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a08a83f5-f76a-46df-b045-912fface69da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:41.750740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a08a83f5-f76a-46df-b045-912fface69da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:41.751536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a08a83f5-f76a-46df-b045-912fface69da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:41.751979 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a08a83f5-f76a-46df-b045-912fface69da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:41.887966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a08a83f5-f76a-46df-b045-912fface69da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:41.895379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a08a83f5-f76a-46df-b045-912fface69da tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.157116 Jul 18 17:27:41.895972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1286/2085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:41 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:41.900238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-9694ba2a-9639-42f4-8acb-1b409cbc116c req-071e638f-ed78-4af1-b4b0-5668f28e2d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f746d48-e85c-4d24-9358-7f6be3b7ab25", "name": "network-vif-plugged", "status": "completed", "tag": "4856c290-15ed-4c21-9b2b-90c006d26dff"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:41.908293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-9694ba2a-9639-42f4-8acb-1b409cbc116c req-071e638f-ed78-4af1-b4b0-5668f28e2d23 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:41.914036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-9694ba2a-9639-42f4-8acb-1b409cbc116c req-071e638f-ed78-4af1-b4b0-5668f28e2d23 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:41.920763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-9694ba2a-9639-42f4-8acb-1b409cbc116c req-071e638f-ed78-4af1-b4b0-5668f28e2d23 service nova] Creating event network-vif-plugged:4856c290-15ed-4c21-9b2b-90c006d26dff for instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 on hv-cinder-84617 Jul 18 17:27:41.926466 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-9694ba2a-9639-42f4-8acb-1b409cbc116c req-071e638f-ed78-4af1-b4b0-5668f28e2d23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029379 Jul 18 17:27:41.927052 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1287/2086] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:27:42.012617 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-25615018-cde3-4bd4-8f9d-7c0c6f24188e tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6ae0a5280>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:42.061030 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-25615018-cde3-4bd4-8f9d-7c0c6f24188e tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/87cc6aa0-d820-42fb-b672-9c32d283edc7" status: 200 len: 351 microversion: 2.1 time: 0.052361 Jul 18 17:27:42.061588 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1288/2087] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 17:27:42 2022] GET /compute/v2.1/os-volumes/87cc6aa0-d820-42fb-b672-9c32d283edc7 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:42.323113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:27:42.327117 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4161667c-8fa1-4536-b016-66ea181ba2da tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:42.327852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4161667c-8fa1-4536-b016-66ea181ba2da tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:42.334387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4161667c-8fa1-4536-b016-66ea181ba2da tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:42.334866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4161667c-8fa1-4536-b016-66ea181ba2da tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:42.335665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4161667c-8fa1-4536-b016-66ea181ba2da tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:42.341274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4161667c-8fa1-4536-b016-66ea181ba2da tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:42.473480 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4161667c-8fa1-4536-b016-66ea181ba2da tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:42.481029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4161667c-8fa1-4536-b016-66ea181ba2da tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1366 microversion: 2.1 time: 0.158771 Jul 18 17:27:42.481603 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1289/2088] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:42 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:42.912092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-da3ea0c3-a721-4bb7-9ef5-954118a58709 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:42.912694 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-da3ea0c3-a721-4bb7-9ef5-954118a58709 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:42.914894 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=20 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:27:42.919724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da3ea0c3-a721-4bb7-9ef5-954118a58709 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:42.920199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da3ea0c3-a721-4bb7-9ef5-954118a58709 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:42.924981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da3ea0c3-a721-4bb7-9ef5-954118a58709 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:42.924981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-da3ea0c3-a721-4bb7-9ef5-954118a58709 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:43.051500 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-da3ea0c3-a721-4bb7-9ef5-954118a58709 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:43.059316 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-da3ea0c3-a721-4bb7-9ef5-954118a58709 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.151909 Jul 18 17:27:43.059927 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1290/2089] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:42 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:43.498841 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ca48b117-0afd-4c40-a80a-ed96ceb606b2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:43.499462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ca48b117-0afd-4c40-a80a-ed96ceb606b2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:43.505786 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca48b117-0afd-4c40-a80a-ed96ceb606b2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:43.506241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca48b117-0afd-4c40-a80a-ed96ceb606b2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:43.507006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca48b117-0afd-4c40-a80a-ed96ceb606b2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:43.507481 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ca48b117-0afd-4c40-a80a-ed96ceb606b2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:43.639346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ca48b117-0afd-4c40-a80a-ed96ceb606b2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:43.647702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ca48b117-0afd-4c40-a80a-ed96ceb606b2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1366 microversion: 2.1 time: 0.152792 Jul 18 17:27:43.648372 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1291/2090] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:43 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:43.666558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-403a7c25-ff9d-479d-af5c-6dcd124c4494 tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6ae0f38b0>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:43.713815 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-403a7c25-ff9d-479d-af5c-6dcd124c4494 tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/08c7e78f-5fcf-4213-af10-6a1492a96bf9" status: 200 len: 350 microversion: 2.1 time: 0.050950 Jul 18 17:27:43.714381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1292/2091] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jul 18 17:27:43 2022] GET /compute/v2.1/os-volumes/08c7e78f-5fcf-4213-af10-6a1492a96bf9 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:43.726051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4c1cd006-b56d-43ae-829e-5c5b170c4cbf tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6adf00e50>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:43.806696 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4c1cd006-b56d-43ae-829e-5c5b170c4cbf tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085104 Jul 18 17:27:43.807263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1293/2092] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jul 18 17:27:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:43.820022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3da1d8c8-bb8b-4638-98a2-672f2637fc4d tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6afcecf70>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:43.903764 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3da1d8c8-bb8b-4638-98a2-672f2637fc4d tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087179 Jul 18 17:27:43.904345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1294/2093] 10.222.0.26 () {58 vars in 1148 bytes} [Mon Jul 18 17:27:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:43.915690 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4a04519e-9684-4895-8a15-adc655965b7f tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6ae3d8ee0>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:43.996404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4a04519e-9684-4895-8a15-adc655965b7f tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084255 Jul 18 17:27:43.997057 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1295/2094] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jul 18 17:27:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:44.007850 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-05748846-5496-4f78-b6b2-ba1bb887d779 tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6ae3ec670>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:44.086540 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-05748846-5496-4f78-b6b2-ba1bb887d779 tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082207 Jul 18 17:27:44.087101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1296/2095] 10.222.0.26 () {58 vars in 1166 bytes} [Mon Jul 18 17:27:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:44.091470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0c4adae1-e146-4a77-9aab-ec7e262bdc9e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:44.092098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0c4adae1-e146-4a77-9aab-ec7e262bdc9e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:44.099227 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c4adae1-e146-4a77-9aab-ec7e262bdc9e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:44.099707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c4adae1-e146-4a77-9aab-ec7e262bdc9e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:44.100465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c4adae1-e146-4a77-9aab-ec7e262bdc9e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:44.100903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c4adae1-e146-4a77-9aab-ec7e262bdc9e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:44.236328 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0c4adae1-e146-4a77-9aab-ec7e262bdc9e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:44.244158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0c4adae1-e146-4a77-9aab-ec7e262bdc9e tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.156068 Jul 18 17:27:44.244702 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1297/2096] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:44 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:27:44.249013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-adff7e39-0abe-46ab-87aa-36914628b39f tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6adef9310>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:44.329434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-adff7e39-0abe-46ab-87aa-36914628b39f tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083703 Jul 18 17:27:44.330008 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1298/2097] 10.222.0.26 () {58 vars in 1169 bytes} [Mon Jul 18 17:27:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:27:44.345870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b515e1cf-d5d4-446f-9e8d-d50a36327f29 tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6ae0a5040>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:44.427780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b515e1cf-d5d4-446f-9e8d-d50a36327f29 tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085459 Jul 18 17:27:44.428346 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1299/2098] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jul 18 17:27:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:44.439262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-929258b9-cacd-42f7-9d00-a93fce980979 tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6adef3040>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:44.521992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-929258b9-cacd-42f7-9d00-a93fce980979 tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086140 Jul 18 17:27:44.522553 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1300/2099] 10.222.0.26 () {58 vars in 1187 bytes} [Mon Jul 18 17:27:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:44.533361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-53d524a7-2703-407f-8c56-b1dd14bb6ebf tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] Calling method '.version_select at 0x7fd6ae301b80>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:44.614430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-53d524a7-2703-407f-8c56-b1dd14bb6ebf tempest-VolumesTestJSON-760822616 tempest-VolumesTestJSON-760822616-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084455 Jul 18 17:27:44.615568 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1301/2100] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jul 18 17:27:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:44.665769 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3d1e9d04-4d51-48b5-8418-89e4d6f98065 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:44.666389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3d1e9d04-4d51-48b5-8418-89e4d6f98065 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:44.672982 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d1e9d04-4d51-48b5-8418-89e4d6f98065 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:44.673429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d1e9d04-4d51-48b5-8418-89e4d6f98065 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:44.674225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d1e9d04-4d51-48b5-8418-89e4d6f98065 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:44.674662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3d1e9d04-4d51-48b5-8418-89e4d6f98065 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:44.815624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3d1e9d04-4d51-48b5-8418-89e4d6f98065 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:44.823266 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3d1e9d04-4d51-48b5-8418-89e4d6f98065 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1555 microversion: 2.1 time: 0.161406 Jul 18 17:27:44.828098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1302/2101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:44 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:44.843205 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7a415284-d4b7-4a6a-9801-be25f3c69132 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:44.843778 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7a415284-d4b7-4a6a-9801-be25f3c69132 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:44.849919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a415284-d4b7-4a6a-9801-be25f3c69132 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:44.850363 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a415284-d4b7-4a6a-9801-be25f3c69132 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:44.853505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a415284-d4b7-4a6a-9801-be25f3c69132 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:44.853505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7a415284-d4b7-4a6a-9801-be25f3c69132 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:44.930223 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7a415284-d4b7-4a6a-9801-be25f3c69132 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090816 Jul 18 17:27:44.931238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1303/2102] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 18 17:27:44 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:45.261851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-708591c2-916b-43f0-ba15-34f0c4f85b90 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:45.263173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-708591c2-916b-43f0-ba15-34f0c4f85b90 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:45.268909 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-708591c2-916b-43f0-ba15-34f0c4f85b90 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:45.269356 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-708591c2-916b-43f0-ba15-34f0c4f85b90 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:45.270123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-708591c2-916b-43f0-ba15-34f0c4f85b90 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:45.270571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-708591c2-916b-43f0-ba15-34f0c4f85b90 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:45.274574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=100 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:27:45.484724 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-708591c2-916b-43f0-ba15-34f0c4f85b90 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:45.493040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-708591c2-916b-43f0-ba15-34f0c4f85b90 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.235146 Jul 18 17:27:45.493614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1304/2103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:45 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:46.060890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-402dc43a-f1a0-4746-a291-08c863284992 req-b536ed02-2b38-4577-ae77-6b1dfbf911b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f746d48-e85c-4d24-9358-7f6be3b7ab25", "tag": "4856c290-15ed-4c21-9b2b-90c006d26dff"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:46.079373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-402dc43a-f1a0-4746-a291-08c863284992 req-b536ed02-2b38-4577-ae77-6b1dfbf911b4 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:46.079853 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-402dc43a-f1a0-4746-a291-08c863284992 req-b536ed02-2b38-4577-ae77-6b1dfbf911b4 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:46.094421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-402dc43a-f1a0-4746-a291-08c863284992 req-b536ed02-2b38-4577-ae77-6b1dfbf911b4 service nova] Creating event network-changed:4856c290-15ed-4c21-9b2b-90c006d26dff for instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 on hv-cinder-84617 Jul 18 17:27:46.100115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-402dc43a-f1a0-4746-a291-08c863284992 req-b536ed02-2b38-4577-ae77-6b1dfbf911b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042883 Jul 18 17:27:46.101178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1305/2104] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:27:46.511178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-192c36b8-7512-45a2-86bb-8f6dde479fae tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:46.512335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-192c36b8-7512-45a2-86bb-8f6dde479fae tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:46.520858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-192c36b8-7512-45a2-86bb-8f6dde479fae tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:46.521733 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-192c36b8-7512-45a2-86bb-8f6dde479fae tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:46.523048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-192c36b8-7512-45a2-86bb-8f6dde479fae tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:46.523780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-192c36b8-7512-45a2-86bb-8f6dde479fae tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:46.678513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-192c36b8-7512-45a2-86bb-8f6dde479fae tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:46.688543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-192c36b8-7512-45a2-86bb-8f6dde479fae tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.182146 Jul 18 17:27:46.689845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1306/2105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:46 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:47.705857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ce25b627-56b5-40b3-a01b-9876c94fac6c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:47.706542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ce25b627-56b5-40b3-a01b-9876c94fac6c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:47.713115 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce25b627-56b5-40b3-a01b-9876c94fac6c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:47.713561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce25b627-56b5-40b3-a01b-9876c94fac6c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:47.714423 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce25b627-56b5-40b3-a01b-9876c94fac6c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:47.714862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ce25b627-56b5-40b3-a01b-9876c94fac6c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:47.854374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ce25b627-56b5-40b3-a01b-9876c94fac6c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:47.861967 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ce25b627-56b5-40b3-a01b-9876c94fac6c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.160537 Jul 18 17:27:47.862668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1307/2106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:47 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:47.867079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-5b008581-168a-4f49-9dff-87cf348fa42c req-edaae060-93ca-49c0-8f2c-722b3c32f60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7247324-03e7-45a5-b149-28069aa739cf", "name": "network-vif-plugged", "status": "completed", "tag": "dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:47.874934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5b008581-168a-4f49-9dff-87cf348fa42c req-edaae060-93ca-49c0-8f2c-722b3c32f60c service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:47.875371 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5b008581-168a-4f49-9dff-87cf348fa42c req-edaae060-93ca-49c0-8f2c-722b3c32f60c service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:47.887361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-5b008581-168a-4f49-9dff-87cf348fa42c req-edaae060-93ca-49c0-8f2c-722b3c32f60c service nova] Creating event network-vif-plugged:dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a for instance a7247324-03e7-45a5-b149-28069aa739cf on hv-cinder-84617 Jul 18 17:27:47.892084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-5b008581-168a-4f49-9dff-87cf348fa42c req-edaae060-93ca-49c0-8f2c-722b3c32f60c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028220 Jul 18 17:27:47.892754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1308/2107] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:27:48.878731 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-510a5ee0-37dc-4cf9-80ce-5eae0085d5f0 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:48.882140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-510a5ee0-37dc-4cf9-80ce-5eae0085d5f0 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:48.886448 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-510a5ee0-37dc-4cf9-80ce-5eae0085d5f0 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:48.886898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-510a5ee0-37dc-4cf9-80ce-5eae0085d5f0 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:48.887829 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-510a5ee0-37dc-4cf9-80ce-5eae0085d5f0 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:48.888289 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-510a5ee0-37dc-4cf9-80ce-5eae0085d5f0 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:49.028469 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-510a5ee0-37dc-4cf9-80ce-5eae0085d5f0 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:49.036187 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-510a5ee0-37dc-4cf9-80ce-5eae0085d5f0 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1266 microversion: 2.1 time: 0.161624 Jul 18 17:27:49.036752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1309/2108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:48 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:50.053344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bc8166b3-da34-4d60-a2e9-da31331346f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:50.054038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bc8166b3-da34-4d60-a2e9-da31331346f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:50.058049 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:27:50.061562 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc8166b3-da34-4d60-a2e9-da31331346f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:50.062010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc8166b3-da34-4d60-a2e9-da31331346f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:50.062775 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc8166b3-da34-4d60-a2e9-da31331346f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:50.063216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc8166b3-da34-4d60-a2e9-da31331346f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:50.204922 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bc8166b3-da34-4d60-a2e9-da31331346f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:50.213646 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bc8166b3-da34-4d60-a2e9-da31331346f7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1453 microversion: 2.1 time: 0.165114 Jul 18 17:27:50.214400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1310/2109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:50 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:50.234781 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a7321873-4c5f-4db7-b301-e59b83ecec4f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:27:50.235389 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a7321873-4c5f-4db7-b301-e59b83ecec4f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:27:50.241958 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7321873-4c5f-4db7-b301-e59b83ecec4f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:50.242407 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7321873-4c5f-4db7-b301-e59b83ecec4f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:50.243169 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7321873-4c5f-4db7-b301-e59b83ecec4f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:50.243665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a7321873-4c5f-4db7-b301-e59b83ecec4f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:50.381246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-a7321873-4c5f-4db7-b301-e59b83ecec4f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:27:50.388886 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a7321873-4c5f-4db7-b301-e59b83ecec4f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1453 microversion: 2.1 time: 0.157747 Jul 18 17:27:50.389469 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1311/2110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:27:50 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:27:52.760599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-01c522ce-d4e2-429b-af9d-3023c49b258a req-eecf1e67-5e44-423f-a340-eba5d575f6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7247324-03e7-45a5-b149-28069aa739cf", "tag": "dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:27:52.771734 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-01c522ce-d4e2-429b-af9d-3023c49b258a req-eecf1e67-5e44-423f-a340-eba5d575f6b5 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:27:52.772186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-01c522ce-d4e2-429b-af9d-3023c49b258a req-eecf1e67-5e44-423f-a340-eba5d575f6b5 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:27:52.785901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-01c522ce-d4e2-429b-af9d-3023c49b258a req-eecf1e67-5e44-423f-a340-eba5d575f6b5 service nova] Creating event network-changed:dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a for instance a7247324-03e7-45a5-b149-28069aa739cf on hv-cinder-84617 Jul 18 17:27:52.791128 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-01c522ce-d4e2-429b-af9d-3023c49b258a req-eecf1e67-5e44-423f-a340-eba5d575f6b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034332 Jul 18 17:27:52.791788 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1312/2111] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:28:03.897414 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:28:03.898017 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:28:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:28:22.165074 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:28:22.165864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=40 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:28:22.169917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-13e31e56-3446-43e6-af82-5360b4104fa6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:22.170492 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-13e31e56-3446-43e6-af82-5360b4104fa6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:22.177674 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13e31e56-3446-43e6-af82-5360b4104fa6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:22.178133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13e31e56-3446-43e6-af82-5360b4104fa6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:22.178889 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13e31e56-3446-43e6-af82-5360b4104fa6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:22.179335 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-13e31e56-3446-43e6-af82-5360b4104fa6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:22.205460 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-13e31e56-3446-43e6-af82-5360b4104fa6 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/ips" status: 200 len: 149 microversion: 2.1 time: 0.042193 Jul 18 17:28:22.206035 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1313/2112] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 17:28:22 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:28:23.885298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a37c3105-96f6-48e9-ab64-321abc654552 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a1a742c-7aa4-45cc-aea9-e92d5e031139"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:28:23.886384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a37c3105-96f6-48e9-ab64-321abc654552 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:23.893995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a37c3105-96f6-48e9-ab64-321abc654552 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:23.894446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a37c3105-96f6-48e9-ab64-321abc654552 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:23.895211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a37c3105-96f6-48e9-ab64-321abc654552 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:23.895692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a37c3105-96f6-48e9-ab64-321abc654552 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:24.665317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a37c3105-96f6-48e9-ab64-321abc654552 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784299 Jul 18 17:28:24.665951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1314/2113] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 17:28:23 2022] POST /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:28:32.164784 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a1a742c-7aa4-45cc-aea9-e92d5e031139"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:28:32.165972 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:32.172308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:32.172749 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:32.173495 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:32.173940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:32.257112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Invalid volume: volume 2a1a742c-7aa4-45cc-aea9-e92d5e031139 is already attached to instances: 7f746d48-e85c-4d24-9358-7f6be3b7ab25 Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: POST /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments HTTP/1.1 Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 74 Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:28:32.258857 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {"volumeAttachment": {"volumeId": "2a1a742c-7aa4-45cc-aea9-e92d5e031139"}} Jul 18 17:28:32.260736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Invalid volume: volume 2a1a742c-7aa4-45cc-aea9-e92d5e031139 is already attached to instances: 7f746d48-e85c-4d24-9358-7f6be3b7ab25 Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'server_id': '7f746d48-e85c-4d24-9358-7f6be3b7ab25', 'body': {'volumeAttachment': {'volumeId': '2a1a742c-7aa4-45cc-aea9-e92d5e031139'}}} Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2a1a742c-7aa4-45cc-aea9-e92d5e031139 is already attached to instances: 7f746d48-e85c-4d24-9358-7f6be3b7ab25 Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:32.261779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2a1a742c-7aa4-45cc-aea9-e92d5e031139 is already attached to instances: 7f746d48-e85c-4d24-9358-7f6be3b7ab25 Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:28:32.263474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:28:32.265188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:28:32.265188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:28:32.265188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:28:32.265188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2a1a742c-7aa4-45cc-aea9-e92d5e031139 is already attached to instances: 7f746d48-e85c-4d24-9358-7f6be3b7ab25 Jul 18 17:28:32.265188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:32.265188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 400 to user: Invalid volume: volume 2a1a742c-7aa4-45cc-aea9-e92d5e031139 is already attached to instances: 7f746d48-e85c-4d24-9358-7f6be3b7ab25 {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:28:32.265188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-43ba1618-1298-468b-bb06-5b0feebb9d69 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101395 Jul 18 17:28:32.265188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1315/2114] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 17:28:32 2022] POST /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 17:28:32.323940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-77362585-3662-4977-9a51-551c21dfd564 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:32.324416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-77362585-3662-4977-9a51-551c21dfd564 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:32.330561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77362585-3662-4977-9a51-551c21dfd564 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:32.331122 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77362585-3662-4977-9a51-551c21dfd564 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:32.332129 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77362585-3662-4977-9a51-551c21dfd564 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:32.332743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77362585-3662-4977-9a51-551c21dfd564 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:32.413995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-77362585-3662-4977-9a51-551c21dfd564 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lazy-loading 'services' on Instance uuid 7f746d48-e85c-4d24-9358-7f6be3b7ab25 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:28:32.601914 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-77362585-3662-4977-9a51-551c21dfd564 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments/2a1a742c-7aa4-45cc-aea9-e92d5e031139" status: 202 len: 0 microversion: 2.1 time: 0.281746 Jul 18 17:28:32.602493 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1316/2115] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 17:28:32 2022] DELETE /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments/2a1a742c-7aa4-45cc-aea9-e92d5e031139 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:28:32.611253 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b291e730-04b4-4ac0-b7c5-47dce54d9843 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:32.612707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b291e730-04b4-4ac0-b7c5-47dce54d9843 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:32.618912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b291e730-04b4-4ac0-b7c5-47dce54d9843 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:32.619365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b291e730-04b4-4ac0-b7c5-47dce54d9843 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:32.620176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b291e730-04b4-4ac0-b7c5-47dce54d9843 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:32.620608 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b291e730-04b4-4ac0-b7c5-47dce54d9843 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:32.650298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b291e730-04b4-4ac0-b7c5-47dce54d9843 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043228 Jul 18 17:28:32.650848 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1317/2116] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:28:32 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:28:33.662459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-adbf99c0-e33c-4a72-a45b-1ffe477257e1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:33.663523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-adbf99c0-e33c-4a72-a45b-1ffe477257e1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:33.669955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-adbf99c0-e33c-4a72-a45b-1ffe477257e1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:33.670405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-adbf99c0-e33c-4a72-a45b-1ffe477257e1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:33.671159 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-adbf99c0-e33c-4a72-a45b-1ffe477257e1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:33.671628 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-adbf99c0-e33c-4a72-a45b-1ffe477257e1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:33.700805 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-adbf99c0-e33c-4a72-a45b-1ffe477257e1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043070 Jul 18 17:28:33.701355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1318/2117] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:28:33 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 17:28:33.763545 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-940612c2-d2cf-4d3e-a55b-6755e8ace98b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:33.764045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-940612c2-d2cf-4d3e-a55b-6755e8ace98b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:33.770259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-940612c2-d2cf-4d3e-a55b-6755e8ace98b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:33.770710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-940612c2-d2cf-4d3e-a55b-6755e8ace98b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:33.771544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-940612c2-d2cf-4d3e-a55b-6755e8ace98b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:33.772066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-940612c2-d2cf-4d3e-a55b-6755e8ace98b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:33.797465 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-940612c2-d2cf-4d3e-a55b-6755e8ace98b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:28:34.058783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-940612c2-d2cf-4d3e-a55b-6755e8ace98b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 204 len: 0 microversion: 2.1 time: 0.298934 Jul 18 17:28:34.059376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1319/2118] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:28:33 2022] DELETE /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:28:34.073081 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-4f13c883-e769-47af-8312-9bdc16bf9e93 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:34.073763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-4f13c883-e769-47af-8312-9bdc16bf9e93 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:34.079705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f13c883-e769-47af-8312-9bdc16bf9e93 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:34.080160 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f13c883-e769-47af-8312-9bdc16bf9e93 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:34.081435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f13c883-e769-47af-8312-9bdc16bf9e93 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:34.081908 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-4f13c883-e769-47af-8312-9bdc16bf9e93 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:34.213701 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-4f13c883-e769-47af-8312-9bdc16bf9e93 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:34.221194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-4f13c883-e769-47af-8312-9bdc16bf9e93 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1680 microversion: 2.1 time: 0.152040 Jul 18 17:28:34.222458 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1320/2119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:34 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:35.240007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-220bddb9-78c6-4426-953e-c5f3392cac6a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:35.240713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-220bddb9-78c6-4426-953e-c5f3392cac6a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:35.247395 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-220bddb9-78c6-4426-953e-c5f3392cac6a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:35.247952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-220bddb9-78c6-4426-953e-c5f3392cac6a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:35.248792 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-220bddb9-78c6-4426-953e-c5f3392cac6a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:35.249303 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-220bddb9-78c6-4426-953e-c5f3392cac6a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:35.431965 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-220bddb9-78c6-4426-953e-c5f3392cac6a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:35.445826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-220bddb9-78c6-4426-953e-c5f3392cac6a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1680 microversion: 2.1 time: 0.206149 Jul 18 17:28:35.445826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1321/2120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:35 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:36.461677 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bcb3ad19-50d0-43a0-a198-d1663152eac8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:36.462381 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bcb3ad19-50d0-43a0-a198-d1663152eac8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:36.468767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bcb3ad19-50d0-43a0-a198-d1663152eac8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:36.469233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bcb3ad19-50d0-43a0-a198-d1663152eac8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:36.469986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bcb3ad19-50d0-43a0-a198-d1663152eac8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:36.470419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bcb3ad19-50d0-43a0-a198-d1663152eac8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:36.533632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bcb3ad19-50d0-43a0-a198-d1663152eac8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:36.541033 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bcb3ad19-50d0-43a0-a198-d1663152eac8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1613 microversion: 2.1 time: 0.083317 Jul 18 17:28:36.541614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1322/2121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:36 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:36.657666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-a0b31278-9e7a-4296-a50d-7c431f7a2f9e req-6c1a5832-fb2b-4360-a71a-8e29f8f284ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f746d48-e85c-4d24-9358-7f6be3b7ab25", "name": "network-vif-deleted", "tag": "4856c290-15ed-4c21-9b2b-90c006d26dff"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:28:36.680286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-a0b31278-9e7a-4296-a50d-7c431f7a2f9e req-6c1a5832-fb2b-4360-a71a-8e29f8f284ea service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:36.681221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-a0b31278-9e7a-4296-a50d-7c431f7a2f9e req-6c1a5832-fb2b-4360-a71a-8e29f8f284ea service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:36.693424 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-a0b31278-9e7a-4296-a50d-7c431f7a2f9e req-6c1a5832-fb2b-4360-a71a-8e29f8f284ea service nova] Creating event network-vif-deleted:4856c290-15ed-4c21-9b2b-90c006d26dff for instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 on hv-cinder-84617 Jul 18 17:28:36.699429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-a0b31278-9e7a-4296-a50d-7c431f7a2f9e req-6c1a5832-fb2b-4360-a71a-8e29f8f284ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046082 Jul 18 17:28:36.700503 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1323/2122] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:28:37.559071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:37.562396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:37.567153 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:37.567631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:37.568398 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:37.568844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:37.602656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:37.603105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:37.603675 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lazy-loading 'fault' on Instance uuid 7f746d48-e85c-4d24-9358-7f6be3b7ab25 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:28:37.650932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:37.658022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0c939f39-f56b-43ef-86fc-03ece093b1d2 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 200 len: 1331 microversion: 2.1 time: 0.103494 Jul 18 17:28:37.658597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1324/2123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:37 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:38.676084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:38.676880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:38.684014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:38.684463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:38.685232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:38.685672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:38.699763 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 HTTP/1.1 Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:28:38.701420 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:28:38.703156 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '7f746d48-e85c-4d24-9358-7f6be3b7ab25'} Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:28:38.704362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:28:38.706511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:28:38.708260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:28:38.708260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-59cdbdea-65a6-4818-9083-4e40a4d8938e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 404 len: 111 microversion: 2.1 time: 0.030985 Jul 18 17:28:38.708260 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1325/2124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:38 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:28:38.711745 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2187376d-72be-4e08-b4e2-4bea5bb04a06 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '.version_select at 0x7fd6b292e160>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:38.790918 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2187376d-72be-4e08-b4e2-4bea5bb04a06 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327466298" status: 202 len: 0 microversion: 2.1 time: 0.082569 Jul 18 17:28:38.791483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1326/2125] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 18 17:28:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327466298 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:28:39.531105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3185b95c-2529-45ea-95d9-01e052ea58d0 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: .version_select at 0x7fd6adf005e0>, body: {"keypair": {"name": "tempest-keypair-1763893336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBei5nWQA3CY9EKVoByIVEgxF4GMua5TvqrpVo2f0kFJfqR0clgmS4ZHSvBuDSWS501GfCLMWApehRosNZaqseM3xKg1jVN0KdM0NT7H62NtNGGDUkHoLyIcrRvQmF9heQ=="}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:28:39.546393 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-3185b95c-2529-45ea-95d9-01e052ea58d0 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for project 60611329802847dd9da7d4d230ab32a4. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:28:39.550852 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-3185b95c-2529-45ea-95d9-01e052ea58d0 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for user a708e1f37fd5453198e32ec6427afcaa and project 60611329802847dd9da7d4d230ab32a4. Resources: {'key_pairs'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:28:39.626060 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3185b95c-2529-45ea-95d9-01e052ea58d0 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099620 Jul 18 17:28:39.626662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1327/2126] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jul 18 17:28:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:28:41.700995 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-213355486", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d93bdb0-53cc-4bb1-8136-c043e0adfbdb"}], "security_groups": [{"name": "tempest-securitygroup--624355458"}], "key_name": "tempest-keypair-1763893336", "user_data": "}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:28:41.802505 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] validate_networks() for [('7d93bdb0-53cc-4bb1-8136-c043e0adfbdb', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:28:42.164952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:28:42.165379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:28:42.165858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:28:42.166269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:28:42.166678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:28:42.175770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:42.176218 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:42.177046 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:42.177483 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:42.195232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for project 60611329802847dd9da7d4d230ab32a4. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:28:42.199177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Getting quotas for user a708e1f37fd5453198e32ec6427afcaa and project 60611329802847dd9da7d4d230ab32a4. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:28:42.213099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:28:42.216249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:28:42.363574 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3ab7cdf6-c604-48b9-97ae-a40e9cae8692 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667414 Jul 18 17:28:42.364220 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1328/2127] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:28:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 17:28:42.373842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-58b93fc5-3c46-4fe7-ba0d-0330ae687fad tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:42.374450 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-58b93fc5-3c46-4fe7-ba0d-0330ae687fad tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:42.426944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-58b93fc5-3c46-4fe7-ba0d-0330ae687fad tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:42.433978 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-58b93fc5-3c46-4fe7-ba0d-0330ae687fad tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1241 microversion: 2.1 time: 0.063850 Jul 18 17:28:42.434541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1329/2128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:42 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:43.450713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-77e183b0-8a64-485f-9416-626b89b2df9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:43.451396 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-77e183b0-8a64-485f-9416-626b89b2df9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:43.458795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77e183b0-8a64-485f-9416-626b89b2df9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:43.461199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77e183b0-8a64-485f-9416-626b89b2df9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:43.461199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77e183b0-8a64-485f-9416-626b89b2df9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:43.461199 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-77e183b0-8a64-485f-9416-626b89b2df9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:43.526201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-77e183b0-8a64-485f-9416-626b89b2df9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:43.529706 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:28:43.534578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-77e183b0-8a64-485f-9416-626b89b2df9f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1237 microversion: 2.1 time: 0.087250 Jul 18 17:28:43.538912 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1330/2129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:43 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:44.551950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-37ccfdea-d08a-4a94-a489-75bd68da2147 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:44.552592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-37ccfdea-d08a-4a94-a489-75bd68da2147 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:44.560246 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ccfdea-d08a-4a94-a489-75bd68da2147 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:44.560507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ccfdea-d08a-4a94-a489-75bd68da2147 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:44.561359 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ccfdea-d08a-4a94-a489-75bd68da2147 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:44.561707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-37ccfdea-d08a-4a94-a489-75bd68da2147 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:44.869957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-37ccfdea-d08a-4a94-a489-75bd68da2147 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:44.877400 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-37ccfdea-d08a-4a94-a489-75bd68da2147 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1299 microversion: 2.1 time: 0.329268 Jul 18 17:28:44.878635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1331/2130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:44 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1299 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:45.895347 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5b787ccc-8065-491d-960d-13d801d1b30c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:45.902092 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5b787ccc-8065-491d-960d-13d801d1b30c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:45.909737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b787ccc-8065-491d-960d-13d801d1b30c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:45.910190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b787ccc-8065-491d-960d-13d801d1b30c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:45.913625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b787ccc-8065-491d-960d-13d801d1b30c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:45.913625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5b787ccc-8065-491d-960d-13d801d1b30c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:46.052624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5b787ccc-8065-491d-960d-13d801d1b30c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:46.061000 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5b787ccc-8065-491d-960d-13d801d1b30c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1366 microversion: 2.1 time: 0.170335 Jul 18 17:28:46.061665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1332/2131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:45 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:28:46.148488 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-6ae6891c-f30e-4173-a974-72d793fbff2e req-65cd59f5-5ade-40aa-9491-26fb718f70fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0597cc0e-e7b1-401f-a6a4-5b8c6f383e25", "tag": "ac89b1b6-bb18-4f2a-9e96-72e0f1dc2726"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:28:46.157135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-6ae6891c-f30e-4173-a974-72d793fbff2e req-65cd59f5-5ade-40aa-9491-26fb718f70fa service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:46.158136 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-6ae6891c-f30e-4173-a974-72d793fbff2e req-65cd59f5-5ade-40aa-9491-26fb718f70fa service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:46.175022 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-6ae6891c-f30e-4173-a974-72d793fbff2e req-65cd59f5-5ade-40aa-9491-26fb718f70fa service nova] Creating event network-changed:ac89b1b6-bb18-4f2a-9e96-72e0f1dc2726 for instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 on hv-cinder-84617 Jul 18 17:28:46.180404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-6ae6891c-f30e-4173-a974-72d793fbff2e req-65cd59f5-5ade-40aa-9491-26fb718f70fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035609 Jul 18 17:28:46.181223 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1333/2132] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:28:47.079066 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d35c3bef-75a5-4732-a6f2-5177a054e9b8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:47.079740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d35c3bef-75a5-4732-a6f2-5177a054e9b8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:47.087257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d35c3bef-75a5-4732-a6f2-5177a054e9b8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:47.087797 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d35c3bef-75a5-4732-a6f2-5177a054e9b8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:47.088566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d35c3bef-75a5-4732-a6f2-5177a054e9b8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:47.089009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d35c3bef-75a5-4732-a6f2-5177a054e9b8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:47.219182 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d35c3bef-75a5-4732-a6f2-5177a054e9b8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:47.227261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d35c3bef-75a5-4732-a6f2-5177a054e9b8 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1366 microversion: 2.1 time: 0.152523 Jul 18 17:28:47.227893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1334/2133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:47 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:48.244473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d2a5d935-4800-4802-bf54-bd8c712c31bb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:48.245109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d2a5d935-4800-4802-bf54-bd8c712c31bb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:48.251752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d2a5d935-4800-4802-bf54-bd8c712c31bb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:48.254865 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d2a5d935-4800-4802-bf54-bd8c712c31bb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:48.254865 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d2a5d935-4800-4802-bf54-bd8c712c31bb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:48.254865 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d2a5d935-4800-4802-bf54-bd8c712c31bb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:48.382578 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d2a5d935-4800-4802-bf54-bd8c712c31bb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:48.390065 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d2a5d935-4800-4802-bf54-bd8c712c31bb tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1366 microversion: 2.1 time: 0.149460 Jul 18 17:28:48.390572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1335/2134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:48 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:49.407296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f074e0d8-e09c-4f84-88bd-d39870df846c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:49.408003 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f074e0d8-e09c-4f84-88bd-d39870df846c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:49.414773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f074e0d8-e09c-4f84-88bd-d39870df846c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:49.415198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f074e0d8-e09c-4f84-88bd-d39870df846c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:49.415973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f074e0d8-e09c-4f84-88bd-d39870df846c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:49.416406 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f074e0d8-e09c-4f84-88bd-d39870df846c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:49.546739 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f074e0d8-e09c-4f84-88bd-d39870df846c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:49.554868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f074e0d8-e09c-4f84-88bd-d39870df846c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1366 microversion: 2.1 time: 0.151475 Jul 18 17:28:49.555427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1336/2135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:49 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:50.572251 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c4699ba2-3616-4871-8eb1-37e9276fb0b7 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:50.572945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c4699ba2-3616-4871-8eb1-37e9276fb0b7 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:50.579476 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4699ba2-3616-4871-8eb1-37e9276fb0b7 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:50.579959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4699ba2-3616-4871-8eb1-37e9276fb0b7 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:50.580828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4699ba2-3616-4871-8eb1-37e9276fb0b7 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:50.581340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c4699ba2-3616-4871-8eb1-37e9276fb0b7 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:50.711619 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c4699ba2-3616-4871-8eb1-37e9276fb0b7 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:50.718851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c4699ba2-3616-4871-8eb1-37e9276fb0b7 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1366 microversion: 2.1 time: 0.150419 Jul 18 17:28:50.719404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1337/2136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:50 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:51.736135 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-48d86e44-d753-4f2e-80fe-07c0d1c3ce8d tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:51.736735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-48d86e44-d753-4f2e-80fe-07c0d1c3ce8d tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:51.743386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48d86e44-d753-4f2e-80fe-07c0d1c3ce8d tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:51.743862 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48d86e44-d753-4f2e-80fe-07c0d1c3ce8d tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:51.744621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48d86e44-d753-4f2e-80fe-07c0d1c3ce8d tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:51.745084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48d86e44-d753-4f2e-80fe-07c0d1c3ce8d tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:51.873431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-48d86e44-d753-4f2e-80fe-07c0d1c3ce8d tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:51.881710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-48d86e44-d753-4f2e-80fe-07c0d1c3ce8d tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1366 microversion: 2.1 time: 0.149374 Jul 18 17:28:51.882283 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1338/2137] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:51 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:52.158528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-cfe55588-f101-44d9-94e2-ccb4bcae467b req-ea25bae5-3314-402c-bec3-44bdb3f39250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0597cc0e-e7b1-401f-a6a4-5b8c6f383e25", "name": "network-vif-plugged", "status": "completed", "tag": "ac89b1b6-bb18-4f2a-9e96-72e0f1dc2726"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:28:52.167223 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-cfe55588-f101-44d9-94e2-ccb4bcae467b req-ea25bae5-3314-402c-bec3-44bdb3f39250 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:52.167710 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-cfe55588-f101-44d9-94e2-ccb4bcae467b req-ea25bae5-3314-402c-bec3-44bdb3f39250 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:52.179473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-cfe55588-f101-44d9-94e2-ccb4bcae467b req-ea25bae5-3314-402c-bec3-44bdb3f39250 service nova] Creating event network-vif-plugged:ac89b1b6-bb18-4f2a-9e96-72e0f1dc2726 for instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 on hv-cinder-84617 Jul 18 17:28:52.185225 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-cfe55588-f101-44d9-94e2-ccb4bcae467b req-ea25bae5-3314-402c-bec3-44bdb3f39250 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031048 Jul 18 17:28:52.185816 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1339/2138] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:28:52.896005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:28:52.896842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=12 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:28:52.901318 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f663a8ee-07ff-4787-88ea-415338b2d126 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:52.902016 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f663a8ee-07ff-4787-88ea-415338b2d126 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:52.909410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f663a8ee-07ff-4787-88ea-415338b2d126 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:52.909410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f663a8ee-07ff-4787-88ea-415338b2d126 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:52.910198 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f663a8ee-07ff-4787-88ea-415338b2d126 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:52.910640 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f663a8ee-07ff-4787-88ea-415338b2d126 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:53.065639 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f663a8ee-07ff-4787-88ea-415338b2d126 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:53.073097 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f663a8ee-07ff-4787-88ea-415338b2d126 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1366 microversion: 2.1 time: 0.178048 Jul 18 17:28:53.073656 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1340/2139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:52 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:28:54.090463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d89d1922-e05a-481c-8807-b540b2190887 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:54.091101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d89d1922-e05a-481c-8807-b540b2190887 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:54.093349 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:28:54.098720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d89d1922-e05a-481c-8807-b540b2190887 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:54.099188 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d89d1922-e05a-481c-8807-b540b2190887 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:54.099971 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d89d1922-e05a-481c-8807-b540b2190887 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:54.100416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d89d1922-e05a-481c-8807-b540b2190887 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:54.229662 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d89d1922-e05a-481c-8807-b540b2190887 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:28:54.237025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d89d1922-e05a-481c-8807-b540b2190887 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1555 microversion: 2.1 time: 0.150602 Jul 18 17:28:54.237582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1341/2140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:28:54 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:28:54.256783 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a860c9fa-f1b2-40b4-bb05-a135fe947abd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:28:54.257410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a860c9fa-f1b2-40b4-bb05-a135fe947abd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:28:54.263868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a860c9fa-f1b2-40b4-bb05-a135fe947abd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:54.264365 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a860c9fa-f1b2-40b4-bb05-a135fe947abd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:54.265570 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a860c9fa-f1b2-40b4-bb05-a135fe947abd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:54.266012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a860c9fa-f1b2-40b4-bb05-a135fe947abd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:54.347338 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a860c9fa-f1b2-40b4-bb05-a135fe947abd tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095120 Jul 18 17:28:54.348373 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1342/2141] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jul 18 17:28:54 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:28:55.342233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-df762441-512e-46f8-8b9b-39666a446037 req-a1a18960-9d5e-4ece-be4a-bb6f41291b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0597cc0e-e7b1-401f-a6a4-5b8c6f383e25", "tag": "ac89b1b6-bb18-4f2a-9e96-72e0f1dc2726"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:28:55.350361 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-df762441-512e-46f8-8b9b-39666a446037 req-a1a18960-9d5e-4ece-be4a-bb6f41291b91 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:28:55.350807 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-df762441-512e-46f8-8b9b-39666a446037 req-a1a18960-9d5e-4ece-be4a-bb6f41291b91 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:28:55.361756 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-df762441-512e-46f8-8b9b-39666a446037 req-a1a18960-9d5e-4ece-be4a-bb6f41291b91 service nova] Creating event network-changed:ac89b1b6-bb18-4f2a-9e96-72e0f1dc2726 for instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 on hv-cinder-84617 Jul 18 17:28:55.367105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-df762441-512e-46f8-8b9b-39666a446037 req-a1a18960-9d5e-4ece-be4a-bb6f41291b91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029484 Jul 18 17:28:55.367924 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1343/2142] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:29:26.618659 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:29:26.619293 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:29:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:29:27.740856 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5697ed6f-c05e-4ef1-a1ed-c8648d051a31 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:27.741451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5697ed6f-c05e-4ef1-a1ed-c8648d051a31 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:27.744178 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=5 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:29:27.744822 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=64 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:29:27.749740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5697ed6f-c05e-4ef1-a1ed-c8648d051a31 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:27.752391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5697ed6f-c05e-4ef1-a1ed-c8648d051a31 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:27.752391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5697ed6f-c05e-4ef1-a1ed-c8648d051a31 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:27.752391 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5697ed6f-c05e-4ef1-a1ed-c8648d051a31 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:27.774558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5697ed6f-c05e-4ef1-a1ed-c8648d051a31 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/ips" status: 200 len: 149 microversion: 2.1 time: 0.037997 Jul 18 17:29:27.775120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1344/2143] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jul 18 17:29:27 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:29:29.382300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3f2e8e0b-024a-45e1-8175-cdcaf1a7a4db tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "706ab6a0-4613-43e1-a8e4-9288387f2cfd"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:29:29.383392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3f2e8e0b-024a-45e1-8175-cdcaf1a7a4db tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:29.391126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f2e8e0b-024a-45e1-8175-cdcaf1a7a4db tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:29.392813 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f2e8e0b-024a-45e1-8175-cdcaf1a7a4db tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:29.392813 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f2e8e0b-024a-45e1-8175-cdcaf1a7a4db tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:29.392813 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3f2e8e0b-024a-45e1-8175-cdcaf1a7a4db tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:30.080051 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3f2e8e0b-024a-45e1-8175-cdcaf1a7a4db tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "POST /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701478 Jul 18 17:29:30.080682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1345/2144] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jul 18 17:29:29 2022] POST /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:29:31.961833 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-445344668", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2096064368", "security_groups": [{"name": "tempest-secgroup-smoke-285184171"}], "block_device_mapping_v2": [{"uuid": "96013577-8a1c-46cd-9379-5143772eb72c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ba382ac1-9c33-468c-acb2-a793dc60447f"}]}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:29:32.082255 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] validate_networks() for [('ba382ac1-9c33-468c-acb2-a793dc60447f', None, None, None, None, None)] {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:29:32.449906 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:29:32.450325 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:29:32.450795 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:29:32.451201 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:29:32.451647 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:29:32.460374 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:32.461383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:32.462174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:32.462612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:32.479713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Getting quotas for project e4afeb76581942e4a0d72e4568907201. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:29:32.484056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Getting quotas for user e1fc02859caf4ac09a85a4e5f962c14b and project e4afeb76581942e4a0d72e4568907201. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:29:32.540740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:29:32.542879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96013577-8a1c-46cd-9379-5143772eb72c',volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:29:32.929773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-eec914a9-9165-4e61-9687-81c06dd76129 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.972174 Jul 18 17:29:32.930748 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1346/2145] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:29:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 17:29:32.940707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-17253a64-5627-44c2-b73d-dbb05a73ad08 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:32.941311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-17253a64-5627-44c2-b73d-dbb05a73ad08 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:32.995684 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-17253a64-5627-44c2-b73d-dbb05a73ad08 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:33.002299 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-17253a64-5627-44c2-b73d-dbb05a73ad08 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1094 microversion: 2.1 time: 0.065536 Jul 18 17:29:33.002863 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1347/2146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:32 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:34.019747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0e1b439b-3130-483d-a240-3aac7cca2496 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:34.020384 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0e1b439b-3130-483d-a240-3aac7cca2496 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:34.027854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e1b439b-3130-483d-a240-3aac7cca2496 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:34.028309 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e1b439b-3130-483d-a240-3aac7cca2496 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:34.029126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e1b439b-3130-483d-a240-3aac7cca2496 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:34.029572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0e1b439b-3130-483d-a240-3aac7cca2496 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:34.091063 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0e1b439b-3130-483d-a240-3aac7cca2496 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:34.098485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0e1b439b-3130-483d-a240-3aac7cca2496 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1136 microversion: 2.1 time: 0.082750 Jul 18 17:29:34.103567 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1348/2147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:34 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:35.115944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3151e56f-4653-4488-95c0-609f1cea3fc2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:35.116649 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3151e56f-4653-4488-95c0-609f1cea3fc2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:35.123878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3151e56f-4653-4488-95c0-609f1cea3fc2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:35.124329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3151e56f-4653-4488-95c0-609f1cea3fc2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:35.125096 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3151e56f-4653-4488-95c0-609f1cea3fc2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:35.125541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3151e56f-4653-4488-95c0-609f1cea3fc2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:35.193301 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3151e56f-4653-4488-95c0-609f1cea3fc2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:35.201686 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3151e56f-4653-4488-95c0-609f1cea3fc2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1210 microversion: 2.1 time: 0.089483 Jul 18 17:29:35.202263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1349/2148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:35 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:36.218484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2ff46373-38ed-463f-8b07-2ccb9f2f4ee6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:36.226521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2ff46373-38ed-463f-8b07-2ccb9f2f4ee6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:36.226521 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2ff46373-38ed-463f-8b07-2ccb9f2f4ee6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:36.227435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2ff46373-38ed-463f-8b07-2ccb9f2f4ee6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:36.228038 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2ff46373-38ed-463f-8b07-2ccb9f2f4ee6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:36.228527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2ff46373-38ed-463f-8b07-2ccb9f2f4ee6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:36.369869 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-2ff46373-38ed-463f-8b07-2ccb9f2f4ee6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:36.378705 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2ff46373-38ed-463f-8b07-2ccb9f2f4ee6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1277 microversion: 2.1 time: 0.163958 Jul 18 17:29:36.383666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1350/2149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:36 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:36.685259 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-7b3e8d7c-d153-4f35-8f97-fde5480f1e71 req-e61b6a78-8dd0-43f9-b4a0-c659108e4067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a7e562-254b-47ae-839c-c75aeec323bd", "tag": "912feee8-d8b9-4ec5-8cfa-a9a5def39337"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:29:36.693452 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-7b3e8d7c-d153-4f35-8f97-fde5480f1e71 req-e61b6a78-8dd0-43f9-b4a0-c659108e4067 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:36.693894 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-7b3e8d7c-d153-4f35-8f97-fde5480f1e71 req-e61b6a78-8dd0-43f9-b4a0-c659108e4067 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:36.705821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-7b3e8d7c-d153-4f35-8f97-fde5480f1e71 req-e61b6a78-8dd0-43f9-b4a0-c659108e4067 service nova] Creating event network-changed:912feee8-d8b9-4ec5-8cfa-a9a5def39337 for instance 39a7e562-254b-47ae-839c-c75aeec323bd on hv-cinder-84617 Jul 18 17:29:36.710457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-7b3e8d7c-d153-4f35-8f97-fde5480f1e71 req-e61b6a78-8dd0-43f9-b4a0-c659108e4067 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029407 Jul 18 17:29:36.711056 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1351/2150] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:29:37.397012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-157109f3-b8a6-46b1-9638-4ed2881156ad tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:37.397703 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-157109f3-b8a6-46b1-9638-4ed2881156ad tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:37.404197 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-157109f3-b8a6-46b1-9638-4ed2881156ad tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:37.404644 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-157109f3-b8a6-46b1-9638-4ed2881156ad tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:37.405624 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-157109f3-b8a6-46b1-9638-4ed2881156ad tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:37.406059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-157109f3-b8a6-46b1-9638-4ed2881156ad tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:37.559508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-157109f3-b8a6-46b1-9638-4ed2881156ad tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:37.571870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-157109f3-b8a6-46b1-9638-4ed2881156ad tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1277 microversion: 2.1 time: 0.178966 Jul 18 17:29:37.572962 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1352/2151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:37 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:38.595826 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3a1103e7-ba06-4366-8c59-f5c102df47e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:38.596416 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3a1103e7-ba06-4366-8c59-f5c102df47e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:38.603262 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a1103e7-ba06-4366-8c59-f5c102df47e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:38.603747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a1103e7-ba06-4366-8c59-f5c102df47e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:38.604571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a1103e7-ba06-4366-8c59-f5c102df47e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:38.605064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3a1103e7-ba06-4366-8c59-f5c102df47e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:38.747202 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3a1103e7-ba06-4366-8c59-f5c102df47e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:38.754725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3a1103e7-ba06-4366-8c59-f5c102df47e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1277 microversion: 2.1 time: 0.162683 Jul 18 17:29:38.755285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1353/2152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:38 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:38.760585 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-9028ea04-be37-4bae-b192-9fca33f595ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:38.761108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-9028ea04-be37-4bae-b192-9fca33f595ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:38.766845 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9028ea04-be37-4bae-b192-9fca33f595ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:38.767293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9028ea04-be37-4bae-b192-9fca33f595ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:38.768083 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9028ea04-be37-4bae-b192-9fca33f595ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:38.768520 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-9028ea04-be37-4bae-b192-9fca33f595ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:38.851939 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-9028ea04-be37-4bae-b192-9fca33f595ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lazy-loading 'services' on Instance uuid 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:29:39.075228 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-9028ea04-be37-4bae-b192-9fca33f595ae tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments/706ab6a0-4613-43e1-a8e4-9288387f2cfd" status: 202 len: 0 microversion: 2.1 time: 0.318595 Jul 18 17:29:39.075821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1354/2153] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jul 18 17:29:38 2022] DELETE /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments/706ab6a0-4613-43e1-a8e4-9288387f2cfd => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:29:39.084635 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ea3a59e8-1495-45cd-bb4f-c558524bae7c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:39.085806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ea3a59e8-1495-45cd-bb4f-c558524bae7c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:39.092760 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea3a59e8-1495-45cd-bb4f-c558524bae7c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:39.093213 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea3a59e8-1495-45cd-bb4f-c558524bae7c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:39.093981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea3a59e8-1495-45cd-bb4f-c558524bae7c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:39.094425 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ea3a59e8-1495-45cd-bb4f-c558524bae7c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:39.126984 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ea3a59e8-1495-45cd-bb4f-c558524bae7c tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046459 Jul 18 17:29:39.130933 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1355/2154] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:29:39 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:29:39.772120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-69fb7a18-c2db-4c69-ba04-5feda69feb6d tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:39.772794 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-69fb7a18-c2db-4c69-ba04-5feda69feb6d tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:39.780140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69fb7a18-c2db-4c69-ba04-5feda69feb6d tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:39.780615 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69fb7a18-c2db-4c69-ba04-5feda69feb6d tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:39.781378 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69fb7a18-c2db-4c69-ba04-5feda69feb6d tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:39.781811 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-69fb7a18-c2db-4c69-ba04-5feda69feb6d tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:39.918718 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-69fb7a18-c2db-4c69-ba04-5feda69feb6d tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:39.926437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-69fb7a18-c2db-4c69-ba04-5feda69feb6d tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1265 microversion: 2.1 time: 0.158105 Jul 18 17:29:39.926999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1356/2155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:39 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:40.138410 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0d1fe9c6-8faa-41f7-8745-68473b8a1740 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:40.139355 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0d1fe9c6-8faa-41f7-8745-68473b8a1740 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:40.145560 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d1fe9c6-8faa-41f7-8745-68473b8a1740 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:40.146014 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d1fe9c6-8faa-41f7-8745-68473b8a1740 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:40.146780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d1fe9c6-8faa-41f7-8745-68473b8a1740 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:40.147444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0d1fe9c6-8faa-41f7-8745-68473b8a1740 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:40.177626 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0d1fe9c6-8faa-41f7-8745-68473b8a1740 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 Jul 18 17:29:40.178186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1357/2156] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:29:40 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:29:40.943916 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-8423bf0d-2845-4e50-85cf-75b674b82351 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:40.944593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-8423bf0d-2845-4e50-85cf-75b674b82351 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:40.951609 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8423bf0d-2845-4e50-85cf-75b674b82351 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:40.951994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8423bf0d-2845-4e50-85cf-75b674b82351 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:40.952747 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8423bf0d-2845-4e50-85cf-75b674b82351 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:40.953181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-8423bf0d-2845-4e50-85cf-75b674b82351 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:41.086905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-8423bf0d-2845-4e50-85cf-75b674b82351 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:41.094457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-8423bf0d-2845-4e50-85cf-75b674b82351 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1265 microversion: 2.1 time: 0.154382 Jul 18 17:29:41.096059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1358/2157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:40 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:41.189586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-caa1ceec-73ac-4963-9085-64451fd3752b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:41.190499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-caa1ceec-73ac-4963-9085-64451fd3752b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:41.197105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-caa1ceec-73ac-4963-9085-64451fd3752b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:41.197550 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-caa1ceec-73ac-4963-9085-64451fd3752b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:41.198298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-caa1ceec-73ac-4963-9085-64451fd3752b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:41.198729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-caa1ceec-73ac-4963-9085-64451fd3752b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:41.229145 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-caa1ceec-73ac-4963-9085-64451fd3752b tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043393 Jul 18 17:29:41.229625 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1359/2158] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jul 18 17:29:41 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 17:29:41.286286 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-357416b7-c318-4f6b-9d7f-8bfcf0891b45 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:41.286775 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-357416b7-c318-4f6b-9d7f-8bfcf0891b45 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:41.293959 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-357416b7-c318-4f6b-9d7f-8bfcf0891b45 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:41.294405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-357416b7-c318-4f6b-9d7f-8bfcf0891b45 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:41.295158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-357416b7-c318-4f6b-9d7f-8bfcf0891b45 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:41.295629 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-357416b7-c318-4f6b-9d7f-8bfcf0891b45 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:41.320408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-357416b7-c318-4f6b-9d7f-8bfcf0891b45 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:29:41.333975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:29:41.578116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-357416b7-c318-4f6b-9d7f-8bfcf0891b45 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 204 len: 0 microversion: 2.1 time: 0.295287 Jul 18 17:29:41.578711 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1360/2159] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:29:41 2022] DELETE /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:29:41.587103 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e0d39c8b-ac5e-4984-8858-05fcfe8fea48 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:41.592108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e0d39c8b-ac5e-4984-8858-05fcfe8fea48 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:41.593798 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0d39c8b-ac5e-4984-8858-05fcfe8fea48 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:41.594247 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0d39c8b-ac5e-4984-8858-05fcfe8fea48 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:41.594992 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0d39c8b-ac5e-4984-8858-05fcfe8fea48 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:41.595428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e0d39c8b-ac5e-4984-8858-05fcfe8fea48 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:41.730459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e0d39c8b-ac5e-4984-8858-05fcfe8fea48 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:41.738248 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e0d39c8b-ac5e-4984-8858-05fcfe8fea48 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1680 microversion: 2.1 time: 0.155189 Jul 18 17:29:41.738812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1361/2160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:41 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:42.110513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-48090803-084a-4ad0-bacd-91dca9199203 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:42.111154 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-48090803-084a-4ad0-bacd-91dca9199203 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:42.118311 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48090803-084a-4ad0-bacd-91dca9199203 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:42.118761 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48090803-084a-4ad0-bacd-91dca9199203 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:42.119606 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48090803-084a-4ad0-bacd-91dca9199203 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:42.120048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-48090803-084a-4ad0-bacd-91dca9199203 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:42.251027 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-48090803-084a-4ad0-bacd-91dca9199203 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:42.259336 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-48090803-084a-4ad0-bacd-91dca9199203 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1265 microversion: 2.1 time: 0.152738 Jul 18 17:29:42.259932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1362/2161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:42 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:42.755071 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c325e22d-a61d-4ccc-877a-14cff812359f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:42.755736 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c325e22d-a61d-4ccc-877a-14cff812359f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:42.757678 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:29:42.762980 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c325e22d-a61d-4ccc-877a-14cff812359f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:42.763433 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c325e22d-a61d-4ccc-877a-14cff812359f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:42.764210 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c325e22d-a61d-4ccc-877a-14cff812359f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:42.764650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c325e22d-a61d-4ccc-877a-14cff812359f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:42.898166 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c325e22d-a61d-4ccc-877a-14cff812359f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:42.905758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c325e22d-a61d-4ccc-877a-14cff812359f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1680 microversion: 2.1 time: 0.154677 Jul 18 17:29:42.906314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1363/2162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:42 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:29:43.276622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-50d76d0e-ca82-415f-a356-47c75842b34b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:43.277294 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-50d76d0e-ca82-415f-a356-47c75842b34b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:43.279274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=8 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:29:43.284849 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50d76d0e-ca82-415f-a356-47c75842b34b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:43.285430 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50d76d0e-ca82-415f-a356-47c75842b34b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:43.286202 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50d76d0e-ca82-415f-a356-47c75842b34b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:43.286645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-50d76d0e-ca82-415f-a356-47c75842b34b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:43.422142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-50d76d0e-ca82-415f-a356-47c75842b34b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:43.429685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-50d76d0e-ca82-415f-a356-47c75842b34b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1265 microversion: 2.1 time: 0.157482 Jul 18 17:29:43.431943 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1364/2163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:43 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:43.922257 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-cccafe52-6914-4023-97f5-f3c1b1ea279e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:43.922950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-cccafe52-6914-4023-97f5-f3c1b1ea279e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:43.929558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cccafe52-6914-4023-97f5-f3c1b1ea279e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:43.930004 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cccafe52-6914-4023-97f5-f3c1b1ea279e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:43.930963 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cccafe52-6914-4023-97f5-f3c1b1ea279e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:43.932109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-cccafe52-6914-4023-97f5-f3c1b1ea279e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:43.998001 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-cccafe52-6914-4023-97f5-f3c1b1ea279e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:44.014713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-cccafe52-6914-4023-97f5-f3c1b1ea279e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1613 microversion: 2.1 time: 0.087776 Jul 18 17:29:44.014713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1365/2164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:43 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:29:44.014713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-66b24163-a550-4181-9363-8532cfdb01cb req-28c2c776-30e6-4fd4-8d04-9fb231dba416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0597cc0e-e7b1-401f-a6a4-5b8c6f383e25", "name": "network-vif-deleted", "tag": "ac89b1b6-bb18-4f2a-9e96-72e0f1dc2726"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:29:44.021945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-66b24163-a550-4181-9363-8532cfdb01cb req-28c2c776-30e6-4fd4-8d04-9fb231dba416 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:44.025773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-66b24163-a550-4181-9363-8532cfdb01cb req-28c2c776-30e6-4fd4-8d04-9fb231dba416 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:44.050905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-66b24163-a550-4181-9363-8532cfdb01cb req-28c2c776-30e6-4fd4-8d04-9fb231dba416 service nova] Creating event network-vif-deleted:ac89b1b6-bb18-4f2a-9e96-72e0f1dc2726 for instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 on hv-cinder-84617 Jul 18 17:29:44.050905 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-66b24163-a550-4181-9363-8532cfdb01cb req-28c2c776-30e6-4fd4-8d04-9fb231dba416 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042466 Jul 18 17:29:44.051428 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1366/2165] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:29:44.447114 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7280890b-16c7-4b73-a2bd-c448fec774e5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:44.447885 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7280890b-16c7-4b73-a2bd-c448fec774e5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:44.454042 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7280890b-16c7-4b73-a2bd-c448fec774e5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:44.454496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7280890b-16c7-4b73-a2bd-c448fec774e5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:44.455256 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7280890b-16c7-4b73-a2bd-c448fec774e5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:44.455730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7280890b-16c7-4b73-a2bd-c448fec774e5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:44.595529 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7280890b-16c7-4b73-a2bd-c448fec774e5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:44.605544 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7280890b-16c7-4b73-a2bd-c448fec774e5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1265 microversion: 2.1 time: 0.162504 Jul 18 17:29:44.606221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1367/2166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:44 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:45.024310 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:45.024923 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:45.031125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:45.031611 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:45.032376 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:45.032817 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:45.066864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:45.066864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:45.066864 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lazy-loading 'fault' on Instance uuid 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:29:45.109324 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a708e1f37fd5453198e32ec6427afcaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60611329802847dd9da7d4d230ab32a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:45.116955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-41640a61-cd54-4667-8391-912b647fb37e tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 200 len: 1331 microversion: 2.1 time: 0.096811 Jul 18 17:29:45.117515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1368/2167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:45 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:45.622627 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b62376e1-0d48-49f2-8d7a-2aca392367e2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:45.623308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b62376e1-0d48-49f2-8d7a-2aca392367e2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:45.629824 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b62376e1-0d48-49f2-8d7a-2aca392367e2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:45.630278 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b62376e1-0d48-49f2-8d7a-2aca392367e2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:45.631031 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b62376e1-0d48-49f2-8d7a-2aca392367e2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:45.631471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b62376e1-0d48-49f2-8d7a-2aca392367e2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:45.766099 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b62376e1-0d48-49f2-8d7a-2aca392367e2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:45.773499 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b62376e1-0d48-49f2-8d7a-2aca392367e2 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1265 microversion: 2.1 time: 0.155014 Jul 18 17:29:45.774068 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1369/2168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:45 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:46.134233 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:46.135543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:46.141530 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:46.142126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:46.142890 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:46.143326 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:46.156851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 HTTP/1.1 Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:29:46.158513 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:46.160444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '0597cc0e-e7b1-401f-a6a4-5b8c6f383e25'} Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:29:46.161515 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:46.163235 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:46.164998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:29:46.164998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1533121f-5d41-4346-9079-57fe7f9a2079 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 404 len: 111 microversion: 2.1 time: 0.029657 Jul 18 17:29:46.164998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1370/2169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:46 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:29:46.168809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-364a56d8-a8b3-4346-9ba5-bedcd162ae7a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '.version_select at 0x7fd6b291a790>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:46.266194 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-364a56d8-a8b3-4346-9ba5-bedcd162ae7a tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763893336" status: 202 len: 0 microversion: 2.1 time: 0.100888 Jul 18 17:29:46.266868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1371/2170] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jul 18 17:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763893336 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 17:29:46.791522 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e47d0387-181e-43ec-9d62-8ab704693224 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:46.792429 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e47d0387-181e-43ec-9d62-8ab704693224 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:46.800392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e47d0387-181e-43ec-9d62-8ab704693224 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:46.800866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e47d0387-181e-43ec-9d62-8ab704693224 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:46.801632 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e47d0387-181e-43ec-9d62-8ab704693224 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:46.802285 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e47d0387-181e-43ec-9d62-8ab704693224 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:46.939352 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-e47d0387-181e-43ec-9d62-8ab704693224 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:46.948915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e47d0387-181e-43ec-9d62-8ab704693224 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1265 microversion: 2.1 time: 0.162643 Jul 18 17:29:46.949489 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1372/2171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:46 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:29:47.965973 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0cf0091f-881b-4fb2-9244-85a32b888a5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:47.966587 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0cf0091f-881b-4fb2-9244-85a32b888a5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:47.973101 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cf0091f-881b-4fb2-9244-85a32b888a5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:47.973553 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cf0091f-881b-4fb2-9244-85a32b888a5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:47.974314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cf0091f-881b-4fb2-9244-85a32b888a5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:47.974755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0cf0091f-881b-4fb2-9244-85a32b888a5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:48.104512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-0cf0091f-881b-4fb2-9244-85a32b888a5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:48.113158 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0cf0091f-881b-4fb2-9244-85a32b888a5c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1265 microversion: 2.1 time: 0.151157 Jul 18 17:29:48.113725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1373/2172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:47 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:48.236844 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:48.237345 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:48.243486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:48.244672 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:48.245385 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:48.245818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:48.258840 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 HTTP/1.1 Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:29:48.261079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.262839 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '0597cc0e-e7b1-401f-a6a4-5b8c6f383e25'} Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:29:48.263898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.265673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.267793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:29:48.267793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-a1193778-ee86-4501-b166-e278cffc2734 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 404 len: 111 microversion: 2.1 time: 0.029591 Jul 18 17:29:48.267793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1374/2173] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:29:48 2022] DELETE /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:29:48.271961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:48.272558 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:48.278781 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:48.279221 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:48.279986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:48.280418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:48.295164 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 HTTP/1.1 Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:29:48.296717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.298269 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '0597cc0e-e7b1-401f-a6a4-5b8c6f383e25'} Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:29:48.299149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. Jul 18 17:29:48.300932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:48.302456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance 0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:29:48.302456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2376b773-90b7-4ff9-b774-aec7b4e2b5a1 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25" status: 404 len: 111 microversion: 2.1 time: 0.030998 Jul 18 17:29:48.302456 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1375/2174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:48 2022] GET /compute/v2.1/servers/0597cc0e-e7b1-401f-a6a4-5b8c6f383e25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:29:48.484045 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-431e4b6f-4dba-42af-8564-89983a9f6232 req-39cb687e-f162-40cc-b22d-8c9df9987fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a7e562-254b-47ae-839c-c75aeec323bd", "name": "network-vif-plugged", "status": "completed", "tag": "912feee8-d8b9-4ec5-8cfa-a9a5def39337"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:29:48.491987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-431e4b6f-4dba-42af-8564-89983a9f6232 req-39cb687e-f162-40cc-b22d-8c9df9987fde service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:48.492432 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-431e4b6f-4dba-42af-8564-89983a9f6232 req-39cb687e-f162-40cc-b22d-8c9df9987fde service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:48.503858 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-431e4b6f-4dba-42af-8564-89983a9f6232 req-39cb687e-f162-40cc-b22d-8c9df9987fde service nova] Creating event network-vif-plugged:912feee8-d8b9-4ec5-8cfa-a9a5def39337 for instance 39a7e562-254b-47ae-839c-c75aeec323bd on hv-cinder-84617 Jul 18 17:29:48.508728 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-431e4b6f-4dba-42af-8564-89983a9f6232 req-39cb687e-f162-40cc-b22d-8c9df9987fde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029214 Jul 18 17:29:48.509312 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1376/2175] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:29:49.131012 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f64ff187-9e96-4aa3-8ecc-b5ffa95f0214 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:49.131658 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f64ff187-9e96-4aa3-8ecc-b5ffa95f0214 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:49.138940 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f64ff187-9e96-4aa3-8ecc-b5ffa95f0214 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.139392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f64ff187-9e96-4aa3-8ecc-b5ffa95f0214 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.140204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f64ff187-9e96-4aa3-8ecc-b5ffa95f0214 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.140697 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f64ff187-9e96-4aa3-8ecc-b5ffa95f0214 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.274434 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f64ff187-9e96-4aa3-8ecc-b5ffa95f0214 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:49.282966 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f64ff187-9e96-4aa3-8ecc-b5ffa95f0214 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1265 microversion: 2.1 time: 0.156847 Jul 18 17:29:49.283561 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1377/2176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:49 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:29:49.520951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:49.521446 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:49.528179 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.528630 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.529386 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.529827 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.542993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 HTTP/1.1 Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:29:49.544655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.546427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '7f746d48-e85c-4d24-9358-7f6be3b7ab25'} Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:29:49.547435 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.549130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.550880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:29:49.550880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3ebfe448-967d-44cb-8283-14a817a58f01 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 404 len: 111 microversion: 2.1 time: 0.028923 Jul 18 17:29:49.550880 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1378/2177] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:29:49 2022] DELETE /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:29:49.553868 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:49.554457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 7f746d48-e85c-4d24-9358-7f6be3b7ab25] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:49.557470 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:29:49.561084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.561555 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.562300 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.562735 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.577975 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 HTTP/1.1 Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:29:49.579462 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.581265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '7f746d48-e85c-4d24-9358-7f6be3b7ab25'} Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:29:49.582126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. Jul 18 17:29:49.583543 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.769314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance 7f746d48-e85c-4d24-9358-7f6be3b7ab25 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:29:49.769314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-98e1d32e-c5d3-4796-88e8-8b64399ac443 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25" status: 404 len: 111 microversion: 2.1 time: 0.030475 Jul 18 17:29:49.769314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1379/2178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:49 2022] GET /compute/v2.1/servers/7f746d48-e85c-4d24-9358-7f6be3b7ab25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:29:49.769314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:49.769314 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:49.770621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.770621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.770621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.770621 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 HTTP/1.1 Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:29:49.770899 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.772176 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77'} Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:29:49.773110 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.774800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.777418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:29:49.777418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1fd3a3d6-ceba-4d45-80ab-af4dd93d5bf4 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 404 len: 111 microversion: 2.1 time: 0.028459 Jul 18 17:29:49.777418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1380/2179] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:29:49 2022] DELETE /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 17:29:49.777418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:49.777418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:49.777743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.777743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.777743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:49.777743 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 HTTP/1.1 Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:29:49.778292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.779542 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77'} Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:29:49.804809 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. Jul 18 17:29:49.805851 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:49.807107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:29:49.807107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-270218c0-01fd-468f-93a5-d9a3ca73da3f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77" status: 404 len: 111 microversion: 2.1 time: 0.029958 Jul 18 17:29:49.807107 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1381/2180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:49 2022] GET /compute/v2.1/servers/fe86ffc2-e0bf-4ed3-9ea7-b92c7b6edc77 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:29:50.301009 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5e6a2a0a-9db7-40f7-8bb9-8fa0e12f103f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:50.301664 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5e6a2a0a-9db7-40f7-8bb9-8fa0e12f103f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:50.309344 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5e6a2a0a-9db7-40f7-8bb9-8fa0e12f103f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:50.309793 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5e6a2a0a-9db7-40f7-8bb9-8fa0e12f103f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:50.310551 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5e6a2a0a-9db7-40f7-8bb9-8fa0e12f103f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:50.310986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5e6a2a0a-9db7-40f7-8bb9-8fa0e12f103f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:50.442054 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5e6a2a0a-9db7-40f7-8bb9-8fa0e12f103f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:50.445514 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:29:50.450032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5e6a2a0a-9db7-40f7-8bb9-8fa0e12f103f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1452 microversion: 2.1 time: 0.153249 Jul 18 17:29:50.450919 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1382/2181] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:50 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:50.466041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-f61e4929-e8ad-44eb-8723-f5d3f0c621d5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:50.466645 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-f61e4929-e8ad-44eb-8723-f5d3f0c621d5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:50.472676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f61e4929-e8ad-44eb-8723-f5d3f0c621d5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:50.473126 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f61e4929-e8ad-44eb-8723-f5d3f0c621d5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:50.473883 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f61e4929-e8ad-44eb-8723-f5d3f0c621d5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:50.474323 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-f61e4929-e8ad-44eb-8723-f5d3f0c621d5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:50.611261 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-f61e4929-e8ad-44eb-8723-f5d3f0c621d5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:29:50.619377 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-f61e4929-e8ad-44eb-8723-f5d3f0c621d5 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1452 microversion: 2.1 time: 0.156828 Jul 18 17:29:50.619902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1383/2182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:50 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:29:51.050265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:51.050996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:51.057273 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:51.057722 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:51.058741 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:51.059173 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:51.073650 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af HTTP/1.1 Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:29:51.075249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.076274 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '54591214-04e4-4bba-b394-917103e800af'} Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:29:51.076881 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.077707 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.078535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:29:51.078535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-2f8f2efa-5831-4074-9776-cf072a26a31f tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "DELETE /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 404 len: 111 microversion: 2.1 time: 0.030414 Jul 18 17:29:51.078535 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1384/2183] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:29:51 2022] DELETE /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:29:51.084830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:29:51.085431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] [instance: 54591214-04e4-4bba-b394-917103e800af] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:29:51.092431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:51.092878 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:51.093633 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:51.094067 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:51.108497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] HTTP exception thrown: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Request method failure captured: Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af HTTP/1.1 Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zd9wmTP2wV808iwzYH0UqvaUo_6lm2Zst0_Lja4LvMqlp0p6Da4CCUpjC3HggrTKLR-a0mayRyXxMgFKHBaHjPFZ1ytw9YwPQ0N9xSKzWUO4oR7e3h5eygS4VhlFU1I-J4nSWQ9OWNVU_icPl0JdcLpM97sD7Q6o8wwtBFUfatnSig Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:29:51.110075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_60611329802847dd9da7d4d230ab32a4", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/60611329802847dd9da7d4d230ab32a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/60611329802847dd9da7d4d230ab32a4"}]}] Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: 60611329802847dd9da7d4d230ab32a4 Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-305092045 Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: a708e1f37fd5453198e32ec6427afcaa Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-AttachVolumeNegativeTest-305092045-project Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.111209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '54591214-04e4-4bba-b394-917103e800af'} Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:29:51.111806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. Jul 18 17:29:51.112676 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:29:51.113528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] Returning 404 to user: Instance 54591214-04e4-4bba-b394-917103e800af could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:29:51.113528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-12ce02ef-e8ec-4da3-9454-75d42ae887d3 tempest-AttachVolumeNegativeTest-305092045 tempest-AttachVolumeNegativeTest-305092045-project] 10.222.0.26 "GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af" status: 404 len: 111 microversion: 2.1 time: 0.030264 Jul 18 17:29:51.113528 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1385/2184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:29:51 2022] GET /compute/v2.1/servers/54591214-04e4-4bba-b394-917103e800af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:29:53.704682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-16e5aaac-9456-4fa0-9423-9c2972f8dce2 req-2396cab5-7070-4890-904a-56f2a7fe0323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a7e562-254b-47ae-839c-c75aeec323bd", "tag": "912feee8-d8b9-4ec5-8cfa-a9a5def39337"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:29:53.729137 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-16e5aaac-9456-4fa0-9423-9c2972f8dce2 req-2396cab5-7070-4890-904a-56f2a7fe0323 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:29:53.729818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-16e5aaac-9456-4fa0-9423-9c2972f8dce2 req-2396cab5-7070-4890-904a-56f2a7fe0323 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:29:53.742292 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-16e5aaac-9456-4fa0-9423-9c2972f8dce2 req-2396cab5-7070-4890-904a-56f2a7fe0323 service nova] Creating event network-changed:912feee8-d8b9-4ec5-8cfa-a9a5def39337 for instance 39a7e562-254b-47ae-839c-c75aeec323bd on hv-cinder-84617 Jul 18 17:29:53.749474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-16e5aaac-9456-4fa0-9423-9c2972f8dce2 req-2396cab5-7070-4890-904a-56f2a7fe0323 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051445 Jul 18 17:29:53.751061 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1386/2185] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:30:32.297713 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=14 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:30:32.298485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=12 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:30:32.302668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-255457835", "imageRef": "2c9b58f4-c854-458e-b6bf-fad98736e5bf", "flavorRef": "452"}} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:30:32.556607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.network.neutron [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] validate_networks() for None {{(pid=124944) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 17:30:32.828767 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Flavor limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 17:30:32.829263 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Image limits 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 17:30:32.829828 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Flavor pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 17:30:32.830313 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Image pref 0:0:0 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 17:30:32.830830 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.virt.hardware [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124944) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 17:30:32.840489 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:32.840944 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:32.841737 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:32.842174 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:32.860317 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Getting quotas for project d2187ae08f914172834e57319d1e4b6f. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 17:30:32.864471 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.quota [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Getting quotas for user d42310eb10f1456992ad1f055fcefe8e and project d2187ae08f914172834e57319d1e4b6f. Resources: {'ram', 'instances', 'cores'} {{(pid=124944) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 17:30:32.876484 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Going to run 1 instances... {{(pid=124944) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 17:30:32.878821 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c9b58f4-c854-458e-b6bf-fad98736e5bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124944) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 17:30:33.014540 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-17b2d559-b70e-4e33-909c-4fc8464dc5ac tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718689 Jul 18 17:30:33.015189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1387/2186] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jul 18 17:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 17:30:33.027321 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-3251c4f8-c70c-4362-a98c-abd4995e5103 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:33.028444 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-3251c4f8-c70c-4362-a98c-abd4995e5103 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:33.086354 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-3251c4f8-c70c-4362-a98c-abd4995e5103 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:33.093897 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-3251c4f8-c70c-4362-a98c-abd4995e5103 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1214 microversion: 2.1 time: 0.071902 Jul 18 17:30:33.094459 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1388/2187] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:33 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:34.110993 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-b0f2ce4f-9f51-42f7-9249-8a10e28e9efb tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:34.111720 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-b0f2ce4f-9f51-42f7-9249-8a10e28e9efb tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:34.119431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0f2ce4f-9f51-42f7-9249-8a10e28e9efb tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:34.119910 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0f2ce4f-9f51-42f7-9249-8a10e28e9efb tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:34.120732 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0f2ce4f-9f51-42f7-9249-8a10e28e9efb tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:34.121232 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-b0f2ce4f-9f51-42f7-9249-8a10e28e9efb tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:34.181214 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-b0f2ce4f-9f51-42f7-9249-8a10e28e9efb tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:34.189419 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-b0f2ce4f-9f51-42f7-9249-8a10e28e9efb tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1218 microversion: 2.1 time: 0.082379 Jul 18 17:30:34.190186 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1389/2188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:34 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:35.206279 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-748b389d-6953-4145-bd47-c1b9b888902e tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:35.207105 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-748b389d-6953-4145-bd47-c1b9b888902e tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:35.213970 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-748b389d-6953-4145-bd47-c1b9b888902e tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:35.214618 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-748b389d-6953-4145-bd47-c1b9b888902e tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:35.215440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-748b389d-6953-4145-bd47-c1b9b888902e tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:35.216013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-748b389d-6953-4145-bd47-c1b9b888902e tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:35.532155 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-748b389d-6953-4145-bd47-c1b9b888902e tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:35.539548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-748b389d-6953-4145-bd47-c1b9b888902e tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1272 microversion: 2.1 time: 0.337094 Jul 18 17:30:35.540104 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1390/2189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:35 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1272 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:30:36.563638 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bc52f186-8d68-455a-b7a0-8990d88f9d16 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:36.564276 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bc52f186-8d68-455a-b7a0-8990d88f9d16 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:36.570654 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc52f186-8d68-455a-b7a0-8990d88f9d16 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:36.571109 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc52f186-8d68-455a-b7a0-8990d88f9d16 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:36.571902 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc52f186-8d68-455a-b7a0-8990d88f9d16 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:36.572340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc52f186-8d68-455a-b7a0-8990d88f9d16 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:36.703084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bc52f186-8d68-455a-b7a0-8990d88f9d16 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:36.710482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bc52f186-8d68-455a-b7a0-8990d88f9d16 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1314 microversion: 2.1 time: 0.152155 Jul 18 17:30:36.711036 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1391/2190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:36 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:37.068887 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-aee8a21a-242a-4514-ae20-a388c9066a73 req-c1a01eaa-9600-4141-961e-0f5a2a999d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce089463-e253-4a59-b27b-5ce6f3d14516", "tag": "b449f039-5b23-43b4-a133-b8b9304b8afd"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:30:37.080234 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-aee8a21a-242a-4514-ae20-a388c9066a73 req-c1a01eaa-9600-4141-961e-0f5a2a999d3e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:37.080682 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-aee8a21a-242a-4514-ae20-a388c9066a73 req-c1a01eaa-9600-4141-961e-0f5a2a999d3e service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:37.093657 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-aee8a21a-242a-4514-ae20-a388c9066a73 req-c1a01eaa-9600-4141-961e-0f5a2a999d3e service nova] Creating event network-changed:b449f039-5b23-43b4-a133-b8b9304b8afd for instance ce089463-e253-4a59-b27b-5ce6f3d14516 on hv-cinder-84617 Jul 18 17:30:37.098998 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-aee8a21a-242a-4514-ae20-a388c9066a73 req-c1a01eaa-9600-4141-961e-0f5a2a999d3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034909 Jul 18 17:30:37.099784 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1392/2191] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:30:37.727571 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1014a835-89d8-4f53-bb2d-fde13546b3aa tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:37.728295 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1014a835-89d8-4f53-bb2d-fde13546b3aa tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:37.734950 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1014a835-89d8-4f53-bb2d-fde13546b3aa tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:37.735399 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1014a835-89d8-4f53-bb2d-fde13546b3aa tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:37.736183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1014a835-89d8-4f53-bb2d-fde13546b3aa tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:37.736622 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1014a835-89d8-4f53-bb2d-fde13546b3aa tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:37.869277 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1014a835-89d8-4f53-bb2d-fde13546b3aa tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:37.877189 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1014a835-89d8-4f53-bb2d-fde13546b3aa tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1314 microversion: 2.1 time: 0.153954 Jul 18 17:30:37.877746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1393/2192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:37 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:38.894086 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-25e860ed-9f29-4b27-84aa-7a25660f09ef tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:38.894725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-25e860ed-9f29-4b27-84aa-7a25660f09ef tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:38.901270 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-25e860ed-9f29-4b27-84aa-7a25660f09ef tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:38.901779 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-25e860ed-9f29-4b27-84aa-7a25660f09ef tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:38.902546 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-25e860ed-9f29-4b27-84aa-7a25660f09ef tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:38.902986 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-25e860ed-9f29-4b27-84aa-7a25660f09ef tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:39.035541 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-25e860ed-9f29-4b27-84aa-7a25660f09ef tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:39.036129 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-25e860ed-9f29-4b27-84aa-7a25660f09ef tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1314 microversion: 2.1 time: 0.145899 Jul 18 17:30:39.036692 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1394/2193] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:38 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:40.053451 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-545e8d80-c3a9-4ee6-a91a-70a8acf3010c tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:40.054041 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-545e8d80-c3a9-4ee6-a91a-70a8acf3010c tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:40.061298 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-545e8d80-c3a9-4ee6-a91a-70a8acf3010c tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:40.061746 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-545e8d80-c3a9-4ee6-a91a-70a8acf3010c tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:40.062497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-545e8d80-c3a9-4ee6-a91a-70a8acf3010c tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:40.062932 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-545e8d80-c3a9-4ee6-a91a-70a8acf3010c tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:40.193155 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-545e8d80-c3a9-4ee6-a91a-70a8acf3010c tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:40.201112 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-545e8d80-c3a9-4ee6-a91a-70a8acf3010c tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1314 microversion: 2.1 time: 0.151474 Jul 18 17:30:40.201673 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1395/2194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:40 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:41.218408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-890b60a3-2c7d-42b1-abcc-c112ce1d8d64 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:41.219006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-890b60a3-2c7d-42b1-abcc-c112ce1d8d64 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:41.225597 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-890b60a3-2c7d-42b1-abcc-c112ce1d8d64 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:41.226048 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-890b60a3-2c7d-42b1-abcc-c112ce1d8d64 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:41.226803 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-890b60a3-2c7d-42b1-abcc-c112ce1d8d64 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:41.227241 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-890b60a3-2c7d-42b1-abcc-c112ce1d8d64 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:41.359715 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-890b60a3-2c7d-42b1-abcc-c112ce1d8d64 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:41.367079 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-890b60a3-2c7d-42b1-abcc-c112ce1d8d64 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1314 microversion: 2.1 time: 0.153180 Jul 18 17:30:41.367671 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1396/2195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:41 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:42.383990 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c1c18883-69ed-41e4-beb2-5d8f8356bf46 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:42.384631 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c1c18883-69ed-41e4-beb2-5d8f8356bf46 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:42.391755 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1c18883-69ed-41e4-beb2-5d8f8356bf46 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:42.392203 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1c18883-69ed-41e4-beb2-5d8f8356bf46 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:42.392955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1c18883-69ed-41e4-beb2-5d8f8356bf46 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:42.393392 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1c18883-69ed-41e4-beb2-5d8f8356bf46 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:42.522566 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c1c18883-69ed-41e4-beb2-5d8f8356bf46 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:42.530265 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c1c18883-69ed-41e4-beb2-5d8f8356bf46 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1314 microversion: 2.1 time: 0.150090 Jul 18 17:30:42.535370 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1397/2196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:42 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:30:42.720666 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-895b2ca4-b981-45b0-a643-88e5feb19673 req-7bfce290-cea9-455b-8dab-d3edc7a58205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce089463-e253-4a59-b27b-5ce6f3d14516", "name": "network-vif-plugged", "status": "completed", "tag": "b449f039-5b23-43b4-a133-b8b9304b8afd"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:30:42.730421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-895b2ca4-b981-45b0-a643-88e5feb19673 req-7bfce290-cea9-455b-8dab-d3edc7a58205 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:42.731224 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-895b2ca4-b981-45b0-a643-88e5feb19673 req-7bfce290-cea9-455b-8dab-d3edc7a58205 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:42.742952 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-895b2ca4-b981-45b0-a643-88e5feb19673 req-7bfce290-cea9-455b-8dab-d3edc7a58205 service nova] Creating event network-vif-plugged:b449f039-5b23-43b4-a133-b8b9304b8afd for instance ce089463-e253-4a59-b27b-5ce6f3d14516 on hv-cinder-84617 Jul 18 17:30:42.748510 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-895b2ca4-b981-45b0-a643-88e5feb19673 req-7bfce290-cea9-455b-8dab-d3edc7a58205 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031595 Jul 18 17:30:42.749098 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1398/2197] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:30:43.544511 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=2 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:30:43.545315 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell0:SELECT=8 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:30:43.549729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d95be088-c827-4aa5-afe0-2eff8e9ed78f tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:43.550417 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d95be088-c827-4aa5-afe0-2eff8e9ed78f tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:43.556752 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d95be088-c827-4aa5-afe0-2eff8e9ed78f tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:43.557206 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d95be088-c827-4aa5-afe0-2eff8e9ed78f tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:43.558125 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d95be088-c827-4aa5-afe0-2eff8e9ed78f tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:43.558812 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d95be088-c827-4aa5-afe0-2eff8e9ed78f tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:43.691296 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d95be088-c827-4aa5-afe0-2eff8e9ed78f tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:43.699379 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d95be088-c827-4aa5-afe0-2eff8e9ed78f tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1314 microversion: 2.1 time: 0.155196 Jul 18 17:30:43.699977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1399/2198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:43 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:44.715999 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-c1e7ac58-8045-49ac-a4f5-010a17989b44 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:44.716599 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-c1e7ac58-8045-49ac-a4f5-010a17989b44 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:44.723116 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1e7ac58-8045-49ac-a4f5-010a17989b44 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:44.723591 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1e7ac58-8045-49ac-a4f5-010a17989b44 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:44.724337 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1e7ac58-8045-49ac-a4f5-010a17989b44 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:44.724768 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-c1e7ac58-8045-49ac-a4f5-010a17989b44 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:44.864436 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-c1e7ac58-8045-49ac-a4f5-010a17989b44 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:44.872532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-c1e7ac58-8045-49ac-a4f5-010a17989b44 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1464 microversion: 2.1 time: 0.160557 Jul 18 17:30:44.875584 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1400/2199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:44 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:44.911216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bb4c9345-cdfe-45be-a316-c98234c2febc tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:44.911750 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bb4c9345-cdfe-45be-a316-c98234c2febc tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:44.918209 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb4c9345-cdfe-45be-a316-c98234c2febc tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:44.918754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb4c9345-cdfe-45be-a316-c98234c2febc tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:44.919519 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb4c9345-cdfe-45be-a316-c98234c2febc tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:44.919955 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bb4c9345-cdfe-45be-a316-c98234c2febc tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:44.944527 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bb4c9345-cdfe-45be-a316-c98234c2febc tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:30:45.276075 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bb4c9345-cdfe-45be-a316-c98234c2febc tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 204 len: 0 microversion: 2.1 time: 0.368265 Jul 18 17:30:45.277222 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1401/2200] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:30:44 2022] DELETE /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:30:45.285501 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-ff0a421a-2ef5-4190-aa5b-36906e53ac68 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:45.286181 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-ff0a421a-2ef5-4190-aa5b-36906e53ac68 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:45.292161 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff0a421a-2ef5-4190-aa5b-36906e53ac68 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:45.293216 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff0a421a-2ef5-4190-aa5b-36906e53ac68 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:45.296140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff0a421a-2ef5-4190-aa5b-36906e53ac68 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:45.296140 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-ff0a421a-2ef5-4190-aa5b-36906e53ac68 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:45.426130 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-ff0a421a-2ef5-4190-aa5b-36906e53ac68 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:45.433506 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-ff0a421a-2ef5-4190-aa5b-36906e53ac68 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1470 microversion: 2.1 time: 0.151919 Jul 18 17:30:45.434304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1402/2201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:45 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:46.451539 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-d1312e93-6302-45f9-ba4b-f7112dd66d70 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:46.452151 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-d1312e93-6302-45f9-ba4b-f7112dd66d70 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:46.458612 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d1312e93-6302-45f9-ba4b-f7112dd66d70 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:46.459059 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d1312e93-6302-45f9-ba4b-f7112dd66d70 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:46.459854 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d1312e93-6302-45f9-ba4b-f7112dd66d70 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:46.460291 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-d1312e93-6302-45f9-ba4b-f7112dd66d70 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:46.590725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-d1312e93-6302-45f9-ba4b-f7112dd66d70 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:46.598149 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-d1312e93-6302-45f9-ba4b-f7112dd66d70 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1470 microversion: 2.1 time: 0.150712 Jul 18 17:30:46.598700 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1403/2202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:46 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:47.175131 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-5d344e7d-1684-4a46-ad0b-1a59257018a1 req-b58e8014-b4e4-49db-854d-ff1b4dd1f0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce089463-e253-4a59-b27b-5ce6f3d14516", "name": "network-vif-deleted", "tag": "b449f039-5b23-43b4-a133-b8b9304b8afd"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:30:47.183901 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5d344e7d-1684-4a46-ad0b-1a59257018a1 req-b58e8014-b4e4-49db-854d-ff1b4dd1f0a2 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:47.187777 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-5d344e7d-1684-4a46-ad0b-1a59257018a1 req-b58e8014-b4e4-49db-854d-ff1b4dd1f0a2 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:47.196190 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-5d344e7d-1684-4a46-ad0b-1a59257018a1 req-b58e8014-b4e4-49db-854d-ff1b4dd1f0a2 service nova] Creating event network-vif-deleted:b449f039-5b23-43b4-a133-b8b9304b8afd for instance ce089463-e253-4a59-b27b-5ce6f3d14516 on hv-cinder-84617 Jul 18 17:30:47.202078 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-5d344e7d-1684-4a46-ad0b-1a59257018a1 req-b58e8014-b4e4-49db-854d-ff1b4dd1f0a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030465 Jul 18 17:30:47.202693 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1404/2203] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:30:47.616801 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:47.617497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:47.625089 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:47.625536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:47.626329 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:47.626770 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:47.645668 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:30:47.658954 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:47.659404 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:47.659879 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.objects.instance [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lazy-loading 'fault' on Instance uuid ce089463-e253-4a59-b27b-5ce6f3d14516 {{(pid=124944) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 17:30:47.703512 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd42310eb10f1456992ad1f055fcefe8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2187ae08f914172834e57319d1e4b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:30:47.711006 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-5dcd2718-b5a6-4ce0-b44a-432cc87b0d1b tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 200 len: 1304 microversion: 2.1 time: 0.098554 Jul 18 17:30:47.711791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1405/2204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:47 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:30:48.728333 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:30:48.728957 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] [instance: ce089463-e253-4a59-b27b-5ce6f3d14516] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:30:48.736931 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:48.737383 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:48.738146 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:30:48.738582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:30:48.751951 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] HTTP exception thrown: Instance ce089463-e253-4a59-b27b-5ce6f3d14516 could not be found. Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Request method failure captured: Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 HTTP/1.1 Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zi2dxX30yT-Sm0iDYpBGXcI_42bSDzo5nS0CUc3kqQe98AT6j3ZSY3QlgzfaX5EY5ddknMabAaPBlyyGfDHnMYd9Bo3ARNdaeshlso9WN5o5c-xnFONBJxahQqduXscffXUyeOs0a1h1Pt6S0I88yTpFAHyWtPFbLmc6LRC_wbpKqQ Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: d2187ae08f914172834e57319d1e4b6f Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-VolumesNegativeTest-552432861 Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:30:48.753582 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2187ae08f914172834e57319d1e4b6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2187ae08f914172834e57319d1e4b6f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2187ae08f914172834e57319d1e4b6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2187ae08f914172834e57319d1e4b6f"}]}] Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-VolumesNegativeTest-552432861 Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: d2187ae08f914172834e57319d1e4b6f Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-VolumesNegativeTest-552432861 Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-VolumesNegativeTest-552432861-project Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: d42310eb10f1456992ad1f055fcefe8e Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-VolumesNegativeTest-552432861-project Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance ce089463-e253-4a59-b27b-5ce6f3d14516 could not be found. Jul 18 17:30:48.762773 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'ce089463-e253-4a59-b27b-5ce6f3d14516'} Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce089463-e253-4a59-b27b-5ce6f3d14516 could not be found. Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:30:48.764308 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce089463-e253-4a59-b27b-5ce6f3d14516 could not be found. Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce089463-e253-4a59-b27b-5ce6f3d14516 could not be found. Jul 18 17:30:48.765482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:30:48.766525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] Returning 404 to user: Instance ce089463-e253-4a59-b27b-5ce6f3d14516 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:30:48.766525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-869b75ed-f80c-468c-968f-8a4deb9f4dc1 tempest-VolumesNegativeTest-552432861 tempest-VolumesNegativeTest-552432861-project] 10.222.0.26 "GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516" status: 404 len: 111 microversion: 2.1 time: 0.030519 Jul 18 17:30:48.766525 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1406/2205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:30:48 2022] GET /compute/v2.1/servers/ce089463-e253-4a59-b27b-5ce6f3d14516 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:30:54.408862 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:30:54.409335 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:30:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:31:22.107969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-15e8fa42-2bc2-4345-a82e-bb2f7a3bf80c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:22.108593 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-15e8fa42-2bc2-4345-a82e-bb2f7a3bf80c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:22.110831 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG dbcounter [-] [124944] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:31:22.116087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15e8fa42-2bc2-4345-a82e-bb2f7a3bf80c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:22.116596 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15e8fa42-2bc2-4345-a82e-bb2f7a3bf80c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:22.117497 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15e8fa42-2bc2-4345-a82e-bb2f7a3bf80c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:22.117884 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-15e8fa42-2bc2-4345-a82e-bb2f7a3bf80c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:22.143307 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-15e8fa42-2bc2-4345-a82e-bb2f7a3bf80c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:31:22.487800 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-15e8fa42-2bc2-4345-a82e-bb2f7a3bf80c tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 204 len: 0 microversion: 2.1 time: 0.385494 Jul 18 17:31:22.488387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1407/2206] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:31:22 2022] DELETE /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:31:22.493409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-2911621a-3ff7-406b-bd3a-ef2aabdd8543 req-76c89ad5-e0a9-42ef-adae-4d690b7b5809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a7e562-254b-47ae-839c-c75aeec323bd", "tag": "912feee8-d8b9-4ec5-8cfa-a9a5def39337"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:31:22.501917 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-2911621a-3ff7-406b-bd3a-ef2aabdd8543 req-76c89ad5-e0a9-42ef-adae-4d690b7b5809 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:22.502362 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-2911621a-3ff7-406b-bd3a-ef2aabdd8543 req-76c89ad5-e0a9-42ef-adae-4d690b7b5809 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:22.514482 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-2911621a-3ff7-406b-bd3a-ef2aabdd8543 req-76c89ad5-e0a9-42ef-adae-4d690b7b5809 service nova] Creating event network-changed:912feee8-d8b9-4ec5-8cfa-a9a5def39337 for instance 39a7e562-254b-47ae-839c-c75aeec323bd on hv-cinder-84617 Jul 18 17:31:22.519981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-2911621a-3ff7-406b-bd3a-ef2aabdd8543 req-76c89ad5-e0a9-42ef-adae-4d690b7b5809 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030307 Jul 18 17:31:22.520580 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1408/2207] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:31:22.525454 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-723ead80-c953-474e-a584-e7c97ecf5a68 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:22.526177 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-723ead80-c953-474e-a584-e7c97ecf5a68 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:22.533369 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-723ead80-c953-474e-a584-e7c97ecf5a68 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:22.533818 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-723ead80-c953-474e-a584-e7c97ecf5a68 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:22.534577 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-723ead80-c953-474e-a584-e7c97ecf5a68 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:22.535011 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-723ead80-c953-474e-a584-e7c97ecf5a68 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:22.669405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-723ead80-c953-474e-a584-e7c97ecf5a68 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:31:22.677211 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-723ead80-c953-474e-a584-e7c97ecf5a68 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1577 microversion: 2.1 time: 0.155532 Jul 18 17:31:22.677791 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1409/2208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:31:22 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:31:23.696437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-6fc1a220-e5b9-4bf5-bab1-24ba15c261e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:23.697123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-6fc1a220-e5b9-4bf5-bab1-24ba15c261e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:23.704330 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6fc1a220-e5b9-4bf5-bab1-24ba15c261e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:23.704780 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6fc1a220-e5b9-4bf5-bab1-24ba15c261e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:23.705536 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6fc1a220-e5b9-4bf5-bab1-24ba15c261e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:23.705981 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-6fc1a220-e5b9-4bf5-bab1-24ba15c261e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:23.843665 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-6fc1a220-e5b9-4bf5-bab1-24ba15c261e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:31:23.851053 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-6fc1a220-e5b9-4bf5-bab1-24ba15c261e7 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1577 microversion: 2.1 time: 0.158700 Jul 18 17:31:23.853537 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1410/2209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:31:23 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:31:23.906082 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:31:23.906564 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:31:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:31:24.545508 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-651b7ec1-0eea-4fc2-ac01-95afcf0951ed req-ae99e010-4808-4c4a-bd71-7c62f3d1b6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a7e562-254b-47ae-839c-c75aeec323bd", "name": "network-vif-deleted", "tag": "912feee8-d8b9-4ec5-8cfa-a9a5def39337"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:31:24.553486 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-651b7ec1-0eea-4fc2-ac01-95afcf0951ed req-ae99e010-4808-4c4a-bd71-7c62f3d1b6d1 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:24.555348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-651b7ec1-0eea-4fc2-ac01-95afcf0951ed req-ae99e010-4808-4c4a-bd71-7c62f3d1b6d1 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:24.567532 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-651b7ec1-0eea-4fc2-ac01-95afcf0951ed req-ae99e010-4808-4c4a-bd71-7c62f3d1b6d1 service nova] Creating event network-vif-deleted:912feee8-d8b9-4ec5-8cfa-a9a5def39337 for instance 39a7e562-254b-47ae-839c-c75aeec323bd on hv-cinder-84617 Jul 18 17:31:24.572290 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-651b7ec1-0eea-4fc2-ac01-95afcf0951ed req-ae99e010-4808-4c4a-bd71-7c62f3d1b6d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030888 Jul 18 17:31:24.572870 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1411/2210] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:31:24.869893 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-934960f4-5972-4c99-a6c9-f15c27e95e1b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:24.870572 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-934960f4-5972-4c99-a6c9-f15c27e95e1b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:24.878754 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-934960f4-5972-4c99-a6c9-f15c27e95e1b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:24.879204 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-934960f4-5972-4c99-a6c9-f15c27e95e1b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:24.880005 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-934960f4-5972-4c99-a6c9-f15c27e95e1b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:24.880440 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-934960f4-5972-4c99-a6c9-f15c27e95e1b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:24.949855 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-934960f4-5972-4c99-a6c9-f15c27e95e1b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:31:24.958013 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-934960f4-5972-4c99-a6c9-f15c27e95e1b tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 200 len: 1225 microversion: 2.1 time: 0.092662 Jul 18 17:31:24.958586 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1412/2211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:31:24 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:31:25.974605 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:25.976120 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: 39a7e562-254b-47ae-839c-c75aeec323bd] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:25.982579 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:25.983021 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:25.983806 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:25.984249 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:25.997439 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] HTTP exception thrown: Instance 39a7e562-254b-47ae-839c-c75aeec323bd could not be found. Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Request method failure captured: Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd HTTP/1.1 Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zdcd81Ms_2Sj_wuc4Sc7z_tdUbQyX5KJYR0oRlgk3QpGUGqdOGUzUfxyJ4oWzxIYh3GjVKDGgy1RgQU1YDlyofJYwUqOkHmotVGNbl1viDBDXtq9zF8LsDVU58T_Zyab00k5G4YNzsTRO5hlVLrswhMfUH4DQor3f8GHt-lgiahdIA Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:31:25.999084 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e4afeb76581942e4a0d72e4568907201", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}] Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: e1fc02859caf4ac09a85a4e5f962c14b Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance 39a7e562-254b-47ae-839c-c75aeec323bd could not be found. Jul 18 17:31:26.000485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': '39a7e562-254b-47ae-839c-c75aeec323bd'} Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39a7e562-254b-47ae-839c-c75aeec323bd could not be found. Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:31:26.001297 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39a7e562-254b-47ae-839c-c75aeec323bd could not be found. Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39a7e562-254b-47ae-839c-c75aeec323bd could not be found. Jul 18 17:31:26.002523 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:26.003655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Returning 404 to user: Instance 39a7e562-254b-47ae-839c-c75aeec323bd could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:31:26.003655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-0875c0c0-8af3-43b4-a9c2-a3aca5d1b219 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd" status: 404 len: 111 microversion: 2.1 time: 0.029776 Jul 18 17:31:26.003655 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1413/2212] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:31:25 2022] GET /compute/v2.1/servers/39a7e562-254b-47ae-839c-c75aeec323bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:31:29.361730 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7bb9e025-5082-4577-8663-5795ebf68705 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:29.362293 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7bb9e025-5082-4577-8663-5795ebf68705 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:29.368725 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bb9e025-5082-4577-8663-5795ebf68705 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:29.369183 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bb9e025-5082-4577-8663-5795ebf68705 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:29.369945 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bb9e025-5082-4577-8663-5795ebf68705 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:29.370387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7bb9e025-5082-4577-8663-5795ebf68705 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:29.396087 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7bb9e025-5082-4577-8663-5795ebf68705 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Going to try to terminate instance {{(pid=124944) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 17:31:29.676034 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7bb9e025-5082-4577-8663-5795ebf68705 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 204 len: 0 microversion: 2.1 time: 0.317747 Jul 18 17:31:29.676548 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1414/2213] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:31:29 2022] DELETE /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 17:31:29.805740 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-3090a0c9-4354-4650-ad09-204c2f7fb68c req-a2c17562-77ab-4322-b6fe-a8c6e79e7fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7247324-03e7-45a5-b149-28069aa739cf", "tag": "dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:31:29.814409 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-3090a0c9-4354-4650-ad09-204c2f7fb68c req-a2c17562-77ab-4322-b6fe-a8c6e79e7fa8 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:29.814921 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-3090a0c9-4354-4650-ad09-204c2f7fb68c req-a2c17562-77ab-4322-b6fe-a8c6e79e7fa8 service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:29.834017 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-3090a0c9-4354-4650-ad09-204c2f7fb68c req-a2c17562-77ab-4322-b6fe-a8c6e79e7fa8 service nova] Creating event network-changed:dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a for instance a7247324-03e7-45a5-b149-28069aa739cf on hv-cinder-84617 Jul 18 17:31:29.839987 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-3090a0c9-4354-4650-ad09-204c2f7fb68c req-a2c17562-77ab-4322-b6fe-a8c6e79e7fa8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159113 Jul 18 17:31:29.841029 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1415/2214] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 17:31:29.846348 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-bc38a499-589b-4d79-9b4c-fc4672c6b7e3 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:29.847032 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-bc38a499-589b-4d79-9b4c-fc4672c6b7e3 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:29.853184 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc38a499-589b-4d79-9b4c-fc4672c6b7e3 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:29.857238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc38a499-589b-4d79-9b4c-fc4672c6b7e3 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:29.857238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc38a499-589b-4d79-9b4c-fc4672c6b7e3 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:29.857238 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-bc38a499-589b-4d79-9b4c-fc4672c6b7e3 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:29.990938 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-bc38a499-589b-4d79-9b4c-fc4672c6b7e3 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:31:29.998463 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-bc38a499-589b-4d79-9b4c-fc4672c6b7e3 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1578 microversion: 2.1 time: 0.156649 Jul 18 17:31:29.999055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1416/2215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:31:29 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 17:31:31.015787 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-7dcc3cbf-c5db-4620-b278-1b623721683f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:31.016408 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-7dcc3cbf-c5db-4620-b278-1b623721683f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:31.022758 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cbf-c5db-4620-b278-1b623721683f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:31.023207 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cbf-c5db-4620-b278-1b623721683f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:31.023994 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cbf-c5db-4620-b278-1b623721683f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:31.024431 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-7dcc3cbf-c5db-4620-b278-1b623721683f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:31.161064 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-7dcc3cbf-c5db-4620-b278-1b623721683f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:31:31.170037 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-7dcc3cbf-c5db-4620-b278-1b623721683f tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1578 microversion: 2.1 time: 0.158911 Jul 18 17:31:31.171282 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1417/2216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:31:31 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:31:31.732402 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [req-2a8cb510-8ce2-4b16-b213-cd544bcf5519 req-42e1cb05-3a08-4433-91cf-b12965bb587f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7247324-03e7-45a5-b149-28069aa739cf", "name": "network-vif-deleted", "tag": "dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a"}]} {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 17:31:31.741421 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-2a8cb510-8ce2-4b16-b213-cd544bcf5519 req-42e1cb05-3a08-4433-91cf-b12965bb587f service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:31.741888 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [req-2a8cb510-8ce2-4b16-b213-cd544bcf5519 req-42e1cb05-3a08-4433-91cf-b12965bb587f service nova] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:31.755842 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.compute.server_external_events [req-2a8cb510-8ce2-4b16-b213-cd544bcf5519 req-42e1cb05-3a08-4433-91cf-b12965bb587f service nova] Creating event network-vif-deleted:dc5f9ee9-39e0-4ea0-8b9b-316b2c13225a for instance a7247324-03e7-45a5-b149-28069aa739cf on hv-cinder-84617 Jul 18 17:31:31.760866 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [req-2a8cb510-8ce2-4b16-b213-cd544bcf5519 req-42e1cb05-3a08-4433-91cf-b12965bb587f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032064 Jul 18 17:31:31.761457 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1418/2217] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jul 18 17:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 17:31:32.190437 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-1391083e-a607-4616-addb-93412be5e230 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:32.191113 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-1391083e-a607-4616-addb-93412be5e230 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:32.198010 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1391083e-a607-4616-addb-93412be5e230 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:32.204142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1391083e-a607-4616-addb-93412be5e230 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:32.204142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1391083e-a607-4616-addb-93412be5e230 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:32.204142 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-1391083e-a607-4616-addb-93412be5e230 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:32.261977 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.policy [None req-1391083e-a607-4616-addb-93412be5e230 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1fc02859caf4ac09a85a4e5f962c14b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4afeb76581942e4a0d72e4568907201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124944) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 17:31:32.273123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-1391083e-a607-4616-addb-93412be5e230 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 200 len: 1226 microversion: 2.1 time: 0.084749 Jul 18 17:31:32.273123 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1419/2218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:31:32 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 17:31:33.286772 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:33.287387 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: a7247324-03e7-45a5-b149-28069aa739cf] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:33.293412 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:33.293860 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:33.294607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:33.295040 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:33.308729 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] HTTP exception thrown: Instance a7247324-03e7-45a5-b149-28069aa739cf could not be found. Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Request method failure captured: Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf HTTP/1.1 Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zdcd81Ms_2Sj_wuc4Sc7z_tdUbQyX5KJYR0oRlgk3QpGUGqdOGUzUfxyJ4oWzxIYh3GjVKDGgy1RgQU1YDlyofJYwUqOkHmotVGNbl1viDBDXtq9zF8LsDVU58T_Zyab00k5G4YNzsTRO5hlVLrswhMfUH4DQor3f8GHt-lgiahdIA Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:31:33.310592 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e4afeb76581942e4a0d72e4568907201", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}] Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: e1fc02859caf4ac09a85a4e5f962c14b Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance a7247324-03e7-45a5-b149-28069aa739cf could not be found. Jul 18 17:31:33.311876 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'a7247324-03e7-45a5-b149-28069aa739cf'} Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7247324-03e7-45a5-b149-28069aa739cf could not be found. Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:31:33.312607 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7247324-03e7-45a5-b149-28069aa739cf could not be found. Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7247324-03e7-45a5-b149-28069aa739cf could not be found. Jul 18 17:31:33.313563 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:33.314401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Returning 404 to user: Instance a7247324-03e7-45a5-b149-28069aa739cf could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:31:33.314401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-26a952f6-5c3d-4f3b-bd7e-c09b51026e8a tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf" status: 404 len: 111 microversion: 2.1 time: 0.029448 Jul 18 17:31:33.314401 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1420/2219] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:31:33 2022] GET /compute/v2.1/servers/a7247324-03e7-45a5-b149-28069aa739cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:31:34.052983 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:34.053474 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:34.059485 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:34.059956 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:34.060961 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:34.061395 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:34.074405 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] HTTP exception thrown: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Request method failure captured: Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: DELETE /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 HTTP/1.1 Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zdcd81Ms_2Sj_wuc4Sc7z_tdUbQyX5KJYR0oRlgk3QpGUGqdOGUzUfxyJ4oWzxIYh3GjVKDGgy1RgQU1YDlyofJYwUqOkHmotVGNbl1viDBDXtq9zF8LsDVU58T_Zyab00k5G4YNzsTRO5hlVLrswhMfUH4DQor3f8GHt-lgiahdIA Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:31:34.075946 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e4afeb76581942e4a0d72e4568907201", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}] Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: e1fc02859caf4ac09a85a4e5f962c14b Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.077133 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'db020acd-c5ee-48df-9832-c5a270c4e9b4'} Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:31:34.077717 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.078934 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.080165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Returning 404 to user: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:31:34.080165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-58d5bf6e-d6c4-481a-9777-b0e767197461 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 404 len: 111 microversion: 2.1 time: 0.028299 Jul 18 17:31:34.080165 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1421/2220] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jul 18 17:31:34 2022] DELETE /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:31:34.085427 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:34.086025 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.compute.api [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] [instance: db020acd-c5ee-48df-9832-c5a270c4e9b4] Fetching instance by UUID {{(pid=124944) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 17:31:34.091996 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:34.093108 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:34.093903 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 17:31:34.094340 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG oslo_concurrency.lockutils [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Lock "ba72f21f-270b-4889-a6c4-a2b12cf658e1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 17:31:34.108969 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.wsgi [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] HTTP exception thrown: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Request method failure captured: Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: request: GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 HTTP/1.1 Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept: application/json Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Accept-Encoding: identity Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Connection: close Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Length: 0 Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Content-Type: application/json Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Host: 10.222.0.26 Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Openstack-System-Scope: None Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: User-Agent: python-urllib3/1.26.9 Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Auth-Token: gAAAAABi1Zdcd81Ms_2Sj_wuc4Sc7z_tdUbQyX5KJYR0oRlgk3QpGUGqdOGUzUfxyJ4oWzxIYh3GjVKDGgy1RgQU1YDlyofJYwUqOkHmotVGNbl1viDBDXtq9zF8LsDVU58T_Zyab00k5G4YNzsTRO5hlVLrswhMfUH4DQor3f8GHt-lgiahdIA Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Id: None Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Domain-Name: None Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Identity-Status: Confirmed Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Is-Admin-Project: True Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Id: default Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Domain-Name: Default Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Project-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Role: member,reader Jul 18 17:31:34.110614 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Roles: member,reader Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e4afeb76581942e4a0d72e4568907201", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e4afeb76581942e4a0d72e4568907201"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e4afeb76581942e4a0d72e4568907201"}]}] Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Id: e4afeb76581942e4a0d72e4568907201 Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-Tenant-Name: tempest-TestVolumeBootPattern-1238644587 Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Id: default Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Domain-Name: Default Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Id: e1fc02859caf4ac09a85a4e5f962c14b Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: X-User-Name: tempest-TestVolumeBootPattern-1238644587-project Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: method: > Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: exception: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.111911 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: action_args: {'id': 'db020acd-c5ee-48df-9832-c5a270c4e9b4'} Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 17:31:34.112496 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. Jul 18 17:31:34.114055 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: ERROR nova.api.openstack.wsgi Jul 18 17:31:34.115132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Returning 404 to user: Instance db020acd-c5ee-48df-9832-c5a270c4e9b4 could not be found. {{(pid=124944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 17:31:34.115132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-e43fddbc-b4d5-41e1-9a8d-23befc5592e6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4" status: 404 len: 111 microversion: 2.1 time: 0.030125 Jul 18 17:31:34.115132 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1422/2221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jul 18 17:31:34 2022] GET /compute/v2.1/servers/db020acd-c5ee-48df-9832-c5a270c4e9b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 17:31:35.600473 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: DEBUG nova.api.openstack.wsgi [None req-dcc151e8-5994-4c48-8dda-5c45ba0df5c6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] Calling method '.version_select at 0x7fd6adfdef70>' {{(pid=124944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 17:31:35.677090 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO nova.api.openstack.requestlog [None req-dcc151e8-5994-4c48-8dda-5c45ba0df5c6 tempest-TestVolumeBootPattern-1238644587 tempest-TestVolumeBootPattern-1238644587-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2096064368" status: 202 len: 0 microversion: 2.1 time: 0.080427 Jul 18 17:31:35.677685 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: [pid: 124944|app: 0|req: 1423/2222] 10.222.0.26 () {58 vars in 1262 bytes} [Mon Jul 18 17:31:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2096064368 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 17:32:46.626845 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:32:46.627416 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:32:49.992507 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:32:49.993007 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:32:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:34:14.417037 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:34:14.417599 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:34:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:34:30.314304 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:34:30.314915 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:34:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:34:43.914521 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:34:43.915003 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:34:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:36:06.637960 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:36:06.638719 dv-cinder-846172-3-iscsi devstack@n-api.service[124945]: Mon Jul 18 17:36:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/295d078f-10f9-4a6d-a3c4-9636ef01a6f7 (ip 10.222.0.26) !!! Jul 18 17:36:10.000913 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:36:10.001418 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:36:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 17:37:05.912898 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 17:37:05.913533 dv-cinder-846172-3-iscsi devstack@n-api.service[124944]: Mon Jul 18 17:37:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!